2023-03-20 10:53:33,727 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-20 10:53:34,142 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5 2023-03-20 10:53:34,163 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-20 10:53:34,163 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b, deleteOnExit=true 2023-03-20 10:53:34,164 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-20 10:53:34,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/test.cache.data in system properties and HBase conf 2023-03-20 10:53:34,166 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/hadoop.tmp.dir in system properties and HBase conf 2023-03-20 10:53:34,167 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/hadoop.log.dir in system properties and HBase conf 2023-03-20 10:53:34,168 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-20 10:53:34,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-20 10:53:34,169 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-20 10:53:34,340 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-20 10:53:34,903 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-20 10:53:34,911 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-20 10:53:34,912 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-20 10:53:34,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-20 10:53:34,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-20 10:53:34,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-20 10:53:34,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-20 10:53:34,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-20 10:53:34,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-20 10:53:34,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-20 10:53:34,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/nfs.dump.dir in system properties and HBase conf 2023-03-20 10:53:34,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/java.io.tmpdir in system properties and HBase conf 2023-03-20 10:53:34,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-20 10:53:34,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-20 10:53:34,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-20 10:53:35,962 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-20 10:53:35,968 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-20 10:53:36,304 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-20 10:53:36,620 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-20 10:53:36,643 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-20 10:53:36,707 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-20 10:53:36,766 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/java.io.tmpdir/Jetty_localhost_localdomain_36705_hdfs____.9jp4a5/webapp 2023-03-20 10:53:36,941 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:36705 2023-03-20 10:53:36,996 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-20 10:53:36,997 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-20 10:53:37,855 WARN [Listener at localhost.localdomain/44265] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-20 10:53:38,143 WARN [Listener at localhost.localdomain/44265] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-20 10:53:38,202 WARN [Listener at localhost.localdomain/44265] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-20 10:53:38,214 INFO [Listener at localhost.localdomain/44265] log.Slf4jLog(67): jetty-6.1.26 2023-03-20 10:53:38,242 INFO [Listener at localhost.localdomain/44265] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/java.io.tmpdir/Jetty_localhost_33453_datanode____8sm89l/webapp 2023-03-20 10:53:38,434 INFO [Listener at localhost.localdomain/44265] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33453 2023-03-20 10:53:39,141 WARN [Listener at localhost.localdomain/43657] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-20 10:53:40,188 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89afebe290ef25b0: Processing first storage report for DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b from datanode fb3adef6-a96c-4d02-988b-61bdefd843de 2023-03-20 10:53:40,190 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89afebe290ef25b0: from storage DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b node DatanodeRegistration(127.0.0.1:33001, datanodeUuid=fb3adef6-a96c-4d02-988b-61bdefd843de, infoPort=36397, infoSecurePort=0, ipcPort=43657, storageInfo=lv=-57;cid=testClusterID;nsid=1935015972;c=1679309616057), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-20 10:53:40,190 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89afebe290ef25b0: Processing first storage report for DS-f7340ac4-7f6f-42eb-b9a6-98986b4ad08f from datanode fb3adef6-a96c-4d02-988b-61bdefd843de 2023-03-20 10:53:40,190 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89afebe290ef25b0: from storage DS-f7340ac4-7f6f-42eb-b9a6-98986b4ad08f node DatanodeRegistration(127.0.0.1:33001, datanodeUuid=fb3adef6-a96c-4d02-988b-61bdefd843de, infoPort=36397, infoSecurePort=0, ipcPort=43657, storageInfo=lv=-57;cid=testClusterID;nsid=1935015972;c=1679309616057), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-20 10:53:40,237 DEBUG [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5 2023-03-20 10:53:40,362 INFO [Listener at localhost.localdomain/43657] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/zookeeper_0, clientPort=62837, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-20 10:53:40,388 INFO [Listener at localhost.localdomain/43657] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62837 2023-03-20 10:53:40,399 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:40,401 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:41,272 INFO [Listener at localhost.localdomain/43657] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64 with version=8 2023-03-20 10:53:41,272 INFO [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/hbase-staging 2023-03-20 10:53:41,747 INFO [Listener at localhost.localdomain/43657] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-20 10:53:42,476 INFO [Listener at localhost.localdomain/43657] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-03-20 10:53:42,518 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-20 10:53:42,519 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-20 10:53:42,520 INFO [Listener at localhost.localdomain/43657] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-20 10:53:42,520 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-20 10:53:42,520 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-20 10:53:42,713 INFO [Listener at localhost.localdomain/43657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-20 10:53:42,808 DEBUG [Listener at localhost.localdomain/43657] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-20 10:53:42,939 INFO [Listener at localhost.localdomain/43657] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39971 2023-03-20 10:53:42,952 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:42,955 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:42,979 INFO [Listener at localhost.localdomain/43657] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39971 connecting to ZooKeeper ensemble=127.0.0.1:62837 2023-03-20 10:53:43,014 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:399710x0, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-20 10:53:43,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39971-0x1002e5d5c8f0000 connected 2023-03-20 10:53:43,070 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-20 10:53:43,071 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-20 10:53:43,074 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-20 10:53:43,083 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39971 2023-03-20 10:53:43,098 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39971 2023-03-20 10:53:43,106 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39971 2023-03-20 10:53:43,117 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39971 2023-03-20 10:53:43,118 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39971 2023-03-20 10:53:43,124 INFO [Listener at localhost.localdomain/43657] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64, hbase.cluster.distributed=false 2023-03-20 10:53:43,231 INFO [Listener at localhost.localdomain/43657] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-03-20 10:53:43,231 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-20 10:53:43,232 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-20 10:53:43,232 INFO [Listener at localhost.localdomain/43657] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-20 10:53:43,232 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-20 10:53:43,233 INFO [Listener at localhost.localdomain/43657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-20 10:53:43,239 INFO [Listener at localhost.localdomain/43657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-20 10:53:43,254 INFO [Listener at localhost.localdomain/43657] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44189 2023-03-20 10:53:43,257 INFO [Listener at localhost.localdomain/43657] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-20 10:53:43,266 DEBUG [Listener at localhost.localdomain/43657] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-20 10:53:43,267 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:43,271 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:43,274 INFO [Listener at localhost.localdomain/43657] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44189 connecting to ZooKeeper ensemble=127.0.0.1:62837 2023-03-20 10:53:43,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:441890x0, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-20 10:53:43,281 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ZKUtil(164): regionserver:441890x0, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-20 10:53:43,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44189-0x1002e5d5c8f0001 connected 2023-03-20 10:53:43,288 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-20 10:53:43,289 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-20 10:53:43,294 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44189 2023-03-20 10:53:43,294 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44189 2023-03-20 10:53:43,295 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44189 2023-03-20 10:53:43,298 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44189 2023-03-20 10:53:43,298 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44189 2023-03-20 10:53:43,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:43,309 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-20 10:53:43,310 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:43,330 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-20 10:53:43,330 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-20 10:53:43,330 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:43,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-20 10:53:43,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,39971,1679309621485 from backup master directory 2023-03-20 10:53:43,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-20 10:53:43,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:43,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-20 10:53:43,336 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-20 10:53:43,336 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:43,339 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-20 10:53:43,346 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-20 10:53:43,458 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/hbase.id with ID: 7508f5fb-dc1c-41f3-a4d0-9cd5225c418a 2023-03-20 10:53:43,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:43,540 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:43,585 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0edd2357 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:53:43,624 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@285d9cd1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:53:43,655 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-20 10:53:43,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-20 10:53:43,680 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-20 10:53:43,680 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-20 10:53:43,682 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-20 10:53:43,687 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-20 10:53:43,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-20 10:53:43,722 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store-tmp 2023-03-20 10:53:43,757 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:43,757 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-20 10:53:43,757 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:53:43,757 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:53:43,757 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-20 10:53:43,757 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:53:43,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:53:43,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-20 10:53:43,760 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/WALs/jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:43,785 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39971%2C1679309621485, suffix=, logDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/WALs/jenkins-hbase20.apache.org,39971,1679309621485, archiveDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/oldWALs, maxLogs=10 2023-03-20 10:53:43,858 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33001,DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b,DISK] 2023-03-20 10:53:43,869 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-20 10:53:43,966 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/WALs/jenkins-hbase20.apache.org,39971,1679309621485/jenkins-hbase20.apache.org%2C39971%2C1679309621485.1679309623799 2023-03-20 10:53:43,976 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33001,DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b,DISK]] 2023-03-20 10:53:43,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:53:43,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:43,982 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-20 10:53:43,984 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-20 10:53:44,072 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-20 10:53:44,083 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-20 10:53:44,130 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-20 10:53:44,148 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:44,158 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-20 10:53:44,160 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-20 10:53:44,182 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-20 10:53:44,192 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:53:44,193 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60301368, jitterRate=-0.10143959522247314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:53:44,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-20 10:53:44,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-20 10:53:44,218 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-20 10:53:44,218 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-20 10:53:44,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-20 10:53:44,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-20 10:53:44,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-03-20 10:53:44,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-20 10:53:44,293 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-20 10:53:44,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-20 10:53:44,330 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-20 10:53:44,335 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-20 10:53:44,338 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-20 10:53:44,344 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-20 10:53:44,349 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-20 10:53:44,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:44,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-20 10:53:44,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-20 10:53:44,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-20 10:53:44,379 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-20 10:53:44,379 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-20 10:53:44,380 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:44,390 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,39971,1679309621485, sessionid=0x1002e5d5c8f0000, setting cluster-up flag (Was=false) 2023-03-20 10:53:44,411 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:44,417 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-20 10:53:44,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:44,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:44,430 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-20 10:53:44,431 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:44,434 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp 2023-03-20 10:53:44,504 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(952): ClusterId : 7508f5fb-dc1c-41f3-a4d0-9cd5225c418a 2023-03-20 10:53:44,509 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-20 10:53:44,514 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-20 10:53:44,514 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-20 10:53:44,518 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-20 10:53:44,519 DEBUG [RS:0;jenkins-hbase20:44189] zookeeper.ReadOnlyZKClient(139): Connect 0x2ee4c951 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:53:44,527 DEBUG [RS:0;jenkins-hbase20:44189] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@202332fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:53:44,528 DEBUG [RS:0;jenkins-hbase20:44189] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@241ca221, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-20 10:53:44,548 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:44189 2023-03-20 10:53:44,552 INFO [RS:0;jenkins-hbase20:44189] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-20 10:53:44,552 INFO [RS:0;jenkins-hbase20:44189] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-20 10:53:44,552 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1023): About to register with Master. 2023-03-20 10:53:44,555 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39971,1679309621485 with isa=jenkins-hbase20.apache.org/148.251.75.209:44189, startcode=1679309623230 2023-03-20 10:53:44,558 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-20 10:53:44,571 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-20 10:53:44,571 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-20 10:53:44,571 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-20 10:53:44,571 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-20 10:53:44,571 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-03-20 10:53:44,572 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,572 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-20 10:53:44,572 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,577 DEBUG [RS:0;jenkins-hbase20:44189] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-20 10:53:44,586 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1679309654586 2023-03-20 10:53:44,589 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-20 10:53:44,592 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-20 10:53:44,592 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-20 10:53:44,605 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-20 10:53:44,607 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-20 10:53:44,613 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-20 10:53:44,614 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-20 10:53:44,614 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-20 10:53:44,614 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-20 10:53:44,618 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-20 10:53:44,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-20 10:53:44,622 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-20 10:53:44,624 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-20 10:53:44,625 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-20 10:53:44,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1679309624626,5,FailOnTimeoutGroup] 2023-03-20 10:53:44,634 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1679309624631,5,FailOnTimeoutGroup] 2023-03-20 10:53:44,634 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,634 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-20 10:53:44,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,636 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50585, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-20 10:53:44,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:44,685 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64 2023-03-20 10:53:44,685 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44265 2023-03-20 10:53:44,685 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-20 10:53:44,691 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-20 10:53:44,693 DEBUG [RS:0;jenkins-hbase20:44189] zookeeper.ZKUtil(162): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:44,693 WARN [RS:0;jenkins-hbase20:44189] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-20 10:53:44,694 INFO [RS:0;jenkins-hbase20:44189] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-20 10:53:44,694 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/WALs/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:44,695 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44189,1679309623230] 2023-03-20 10:53:44,704 DEBUG [RS:0;jenkins-hbase20:44189] zookeeper.ZKUtil(162): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:44,715 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-20 10:53:44,723 INFO [RS:0;jenkins-hbase20:44189] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-20 10:53:44,751 INFO [RS:0;jenkins-hbase20:44189] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-20 10:53:44,757 INFO [RS:0;jenkins-hbase20:44189] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:53:44,758 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,760 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-20 10:53:44,771 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,772 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,772 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,773 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,773 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,773 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,773 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-20 10:53:44,774 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,774 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,774 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,774 DEBUG [RS:0;jenkins-hbase20:44189] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-20 10:53:44,776 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,776 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,776 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,798 INFO [RS:0;jenkins-hbase20:44189] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-20 10:53:44,802 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44189,1679309623230-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:44,829 INFO [RS:0;jenkins-hbase20:44189] regionserver.Replication(203): jenkins-hbase20.apache.org,44189,1679309623230 started 2023-03-20 10:53:44,829 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,44189,1679309623230, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44189, sessionid=0x1002e5d5c8f0001 2023-03-20 10:53:44,829 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-20 10:53:44,830 DEBUG [RS:0;jenkins-hbase20:44189] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:44,830 DEBUG [RS:0;jenkins-hbase20:44189] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44189,1679309623230' 2023-03-20 10:53:44,830 DEBUG [RS:0;jenkins-hbase20:44189] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:44,831 DEBUG [RS:0;jenkins-hbase20:44189] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:44,831 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-20 10:53:44,831 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-20 10:53:44,831 DEBUG [RS:0;jenkins-hbase20:44189] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:44,831 DEBUG [RS:0;jenkins-hbase20:44189] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44189,1679309623230' 2023-03-20 10:53:44,831 DEBUG [RS:0;jenkins-hbase20:44189] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-20 10:53:44,832 DEBUG [RS:0;jenkins-hbase20:44189] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-20 10:53:44,832 DEBUG [RS:0;jenkins-hbase20:44189] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-20 10:53:44,832 INFO [RS:0;jenkins-hbase20:44189] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-20 10:53:44,832 INFO [RS:0;jenkins-hbase20:44189] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-20 10:53:44,942 INFO [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44189%2C1679309623230, suffix=, logDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/WALs/jenkins-hbase20.apache.org,44189,1679309623230, archiveDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/oldWALs, maxLogs=32 2023-03-20 10:53:44,958 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33001,DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b,DISK] 2023-03-20 10:53:44,962 INFO [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/WALs/jenkins-hbase20.apache.org,44189,1679309623230/jenkins-hbase20.apache.org%2C44189%2C1679309623230.1679309624944 2023-03-20 10:53:44,962 DEBUG [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33001,DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b,DISK]] 2023-03-20 10:53:45,061 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-20 10:53:45,062 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-20 10:53:45,063 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64 2023-03-20 10:53:45,479 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:45,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-20 10:53:45,485 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/info 2023-03-20 10:53:45,486 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-20 10:53:45,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:45,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-20 10:53:45,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/rep_barrier 2023-03-20 10:53:45,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-20 10:53:45,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:45,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-20 10:53:45,496 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/table 2023-03-20 10:53:45,496 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-20 10:53:45,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:45,500 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740 2023-03-20 10:53:45,501 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740 2023-03-20 10:53:45,506 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-20 10:53:45,508 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-20 10:53:45,511 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:53:45,513 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72951922, jitterRate=0.0870683491230011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-20 10:53:45,513 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-20 10:53:45,513 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-20 10:53:45,513 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-20 10:53:45,513 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-20 10:53:45,513 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-20 10:53:45,513 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-20 10:53:45,514 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-20 10:53:45,514 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-20 10:53:45,518 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-20 10:53:45,518 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-20 10:53:45,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-20 10:53:45,539 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-20 10:53:45,542 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-20 10:53:45,694 DEBUG [jenkins-hbase20:39971] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-20 10:53:45,697 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44189,1679309623230, state=OPENING 2023-03-20 10:53:45,709 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-20 10:53:45,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:45,711 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-20 10:53:45,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:53:45,901 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:45,904 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-20 10:53:45,908 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-20 10:53:45,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-20 10:53:45,920 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-20 10:53:45,923 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44189%2C1679309623230.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/WALs/jenkins-hbase20.apache.org,44189,1679309623230, archiveDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/oldWALs, maxLogs=32 2023-03-20 10:53:45,943 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33001,DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b,DISK] 2023-03-20 10:53:45,958 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/WALs/jenkins-hbase20.apache.org,44189,1679309623230/jenkins-hbase20.apache.org%2C44189%2C1679309623230.meta.1679309625924.meta 2023-03-20 10:53:45,962 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33001,DS-a73ffaa8-6a8e-4d05-b34f-a3a5099aa48b,DISK]] 2023-03-20 10:53:45,962 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:53:45,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-20 10:53:45,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-20 10:53:45,994 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-20 10:53:46,000 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-20 10:53:46,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:46,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-20 10:53:46,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-20 10:53:46,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-20 10:53:46,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/info 2023-03-20 10:53:46,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/info 2023-03-20 10:53:46,010 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-20 10:53:46,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:46,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-20 10:53:46,013 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/rep_barrier 2023-03-20 10:53:46,014 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/rep_barrier 2023-03-20 10:53:46,015 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-20 10:53:46,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:46,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-20 10:53:46,021 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/table 2023-03-20 10:53:46,021 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/table 2023-03-20 10:53:46,022 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-20 10:53:46,023 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:46,026 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740 2023-03-20 10:53:46,031 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740 2023-03-20 10:53:46,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-20 10:53:46,040 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-20 10:53:46,042 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61022802, jitterRate=-0.09068939089775085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-20 10:53:46,042 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-20 10:53:46,055 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1679309625894 2023-03-20 10:53:46,071 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-20 10:53:46,072 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-20 10:53:46,073 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44189,1679309623230, state=OPEN 2023-03-20 10:53:46,076 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-20 10:53:46,076 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-20 10:53:46,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-20 10:53:46,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44189,1679309623230 in 363 msec 2023-03-20 10:53:46,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-20 10:53:46,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 559 msec 2023-03-20 10:53:46,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.6050 sec 2023-03-20 10:53:46,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1679309626098, completionTime=-1 2023-03-20 10:53:46,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-20 10:53:46,099 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-03-20 10:53:46,187 DEBUG [hconnection-0x43cd8bc0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:53:46,197 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:53:46,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-03-20 10:53:46,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1679309686222 2023-03-20 10:53:46,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1679309746222 2023-03-20 10:53:46,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-03-20 10:53:46,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39971,1679309621485-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:46,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39971,1679309621485-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:46,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39971,1679309621485-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:46,273 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:39971, period=300000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:46,274 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-20 10:53:46,280 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-20 10:53:46,290 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-20 10:53:46,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-20 10:53:46,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-20 10:53:46,305 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:53:46,308 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:53:46,340 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:46,344 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8 empty. 2023-03-20 10:53:46,346 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:46,346 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-20 10:53:46,790 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-20 10:53:46,795 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c1e9acaa26c9ee69458ec3df6c75ea8, NAME => 'hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:53:46,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:46,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1c1e9acaa26c9ee69458ec3df6c75ea8, disabling compactions & flushes 2023-03-20 10:53:46,872 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:46,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:46,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. after waiting 0 ms 2023-03-20 10:53:46,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:46,872 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:46,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1c1e9acaa26c9ee69458ec3df6c75ea8: 2023-03-20 10:53:46,879 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:53:46,904 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679309626886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309626886"}]},"ts":"1679309626886"} 2023-03-20 10:53:46,962 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:53:46,967 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:53:46,974 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309626967"}]},"ts":"1679309626967"} 2023-03-20 10:53:46,983 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-20 10:53:46,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1c1e9acaa26c9ee69458ec3df6c75ea8, ASSIGN}] 2023-03-20 10:53:46,996 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1c1e9acaa26c9ee69458ec3df6c75ea8, ASSIGN 2023-03-20 10:53:46,998 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1c1e9acaa26c9ee69458ec3df6c75ea8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:53:47,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1c1e9acaa26c9ee69458ec3df6c75ea8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:47,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679309627149"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309627149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309627149"}]},"ts":"1679309627149"} 2023-03-20 10:53:47,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1c1e9acaa26c9ee69458ec3df6c75ea8, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:53:47,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:47,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c1e9acaa26c9ee69458ec3df6c75ea8, NAME => 'hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:53:47,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,334 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:47,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,342 INFO [StoreOpener-1c1e9acaa26c9ee69458ec3df6c75ea8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,349 DEBUG [StoreOpener-1c1e9acaa26c9ee69458ec3df6c75ea8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/info 2023-03-20 10:53:47,349 DEBUG [StoreOpener-1c1e9acaa26c9ee69458ec3df6c75ea8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/info 2023-03-20 10:53:47,350 INFO [StoreOpener-1c1e9acaa26c9ee69458ec3df6c75ea8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c1e9acaa26c9ee69458ec3df6c75ea8 columnFamilyName info 2023-03-20 10:53:47,351 INFO [StoreOpener-1c1e9acaa26c9ee69458ec3df6c75ea8-1] regionserver.HStore(310): Store=1c1e9acaa26c9ee69458ec3df6c75ea8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:47,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,355 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,361 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:53:47,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:53:47,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1c1e9acaa26c9ee69458ec3df6c75ea8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59006493, jitterRate=-0.12073473632335663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:53:47,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1c1e9acaa26c9ee69458ec3df6c75ea8: 2023-03-20 10:53:47,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8., pid=6, masterSystemTime=1679309627317 2023-03-20 10:53:47,374 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:47,375 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:53:47,376 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1c1e9acaa26c9ee69458ec3df6c75ea8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:47,377 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679309627376"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309627376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309627376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309627376"}]},"ts":"1679309627376"} 2023-03-20 10:53:47,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-20 10:53:47,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1c1e9acaa26c9ee69458ec3df6c75ea8, server=jenkins-hbase20.apache.org,44189,1679309623230 in 226 msec 2023-03-20 10:53:47,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-20 10:53:47,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1c1e9acaa26c9ee69458ec3df6c75ea8, ASSIGN in 393 msec 2023-03-20 10:53:47,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:53:47,390 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309627390"}]},"ts":"1679309627390"} 2023-03-20 10:53:47,394 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-20 10:53:47,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:53:47,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.1040 sec 2023-03-20 10:53:47,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-20 10:53:47,409 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-20 10:53:47,409 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:53:47,451 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-20 10:53:47,470 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-20 10:53:47,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-03-20 10:53:47,485 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-20 10:53:47,509 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-20 10:53:47,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 29 msec 2023-03-20 10:53:47,542 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-20 10:53:47,544 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-20 10:53:47,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.210sec 2023-03-20 10:53:47,548 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-20 10:53:47,550 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-20 10:53:47,551 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-20 10:53:47,552 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39971,1679309621485-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-20 10:53:47,554 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39971,1679309621485-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-20 10:53:47,564 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-20 10:53:47,622 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(139): Connect 0x11ea4006 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:53:47,632 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e84ba3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:53:47,665 DEBUG [hconnection-0x131f5260-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:53:47,677 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:53:47,689 INFO [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:53:47,690 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(139): Connect 0x1f820396 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:53:47,709 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10204f91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:53:47,710 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:53:47,735 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=794, ProcessCount=186, AvailableMemoryMB=9617 2023-03-20 10:53:47,749 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:53:47,754 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33896, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:53:47,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-20 10:53:47,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:47,774 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:53:47,779 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:53:47,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-20 10:53:47,782 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd 2023-03-20 10:53:47,784 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd empty. 2023-03-20 10:53:47,786 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd 2023-03-20 10:53:47,786 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-20 10:53:47,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-20 10:53:47,809 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-20 10:53:47,811 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => b297fedee688520fa896c9eed857babd, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:53:47,827 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:47,827 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing b297fedee688520fa896c9eed857babd, disabling compactions & flushes 2023-03-20 10:53:47,827 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:47,827 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:47,827 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. after waiting 0 ms 2023-03-20 10:53:47,827 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:47,827 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:47,827 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:47,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:53:47,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309627836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309627836"}]},"ts":"1679309627836"} 2023-03-20 10:53:47,840 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:53:47,842 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:53:47,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309627842"}]},"ts":"1679309627842"} 2023-03-20 10:53:47,845 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-20 10:53:47,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, ASSIGN}] 2023-03-20 10:53:47,852 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, ASSIGN 2023-03-20 10:53:47,855 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:53:47,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-20 10:53:48,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b297fedee688520fa896c9eed857babd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:48,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309628008"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309628008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309628008"}]},"ts":"1679309628008"} 2023-03-20 10:53:48,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b297fedee688520fa896c9eed857babd, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:53:48,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-20 10:53:48,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:48,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b297fedee688520fa896c9eed857babd, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:53:48,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:48,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,180 INFO [StoreOpener-b297fedee688520fa896c9eed857babd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,186 DEBUG [StoreOpener-b297fedee688520fa896c9eed857babd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:48,186 DEBUG [StoreOpener-b297fedee688520fa896c9eed857babd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:48,193 INFO [StoreOpener-b297fedee688520fa896c9eed857babd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b297fedee688520fa896c9eed857babd columnFamilyName family1 2023-03-20 10:53:48,201 INFO [StoreOpener-b297fedee688520fa896c9eed857babd-1] regionserver.HStore(310): Store=b297fedee688520fa896c9eed857babd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:48,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b297fedee688520fa896c9eed857babd 2023-03-20 10:53:48,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:53:48,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b297fedee688520fa896c9eed857babd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65852285, jitterRate=-0.018724486231803894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:53:48,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:48,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., pid=11, masterSystemTime=1679309628170 2023-03-20 10:53:48,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:48,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:48,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b297fedee688520fa896c9eed857babd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:48,248 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309628247"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309628247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309628247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309628247"}]},"ts":"1679309628247"} 2023-03-20 10:53:48,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-20 10:53:48,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b297fedee688520fa896c9eed857babd, server=jenkins-hbase20.apache.org,44189,1679309623230 in 238 msec 2023-03-20 10:53:48,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-20 10:53:48,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, ASSIGN in 411 msec 2023-03-20 10:53:48,269 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:53:48,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309628270"}]},"ts":"1679309628270"} 2023-03-20 10:53:48,275 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-20 10:53:48,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:53:48,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 509 msec 2023-03-20 10:53:48,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-20 10:53:48,409 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-20 10:53:48,430 DEBUG [hconnection-0x4b85fd86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:53:48,434 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:53:48,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,626 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:48,626 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:48,627 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:48,627 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:48,628 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,628 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,629 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:48,629 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:48,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:48,630 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:48,630 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,631 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:48,633 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:48,633 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:48,634 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:48,634 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:48,634 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:48,634 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:48,635 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:48,636 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:53:49,281 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130712b915b6c704139b0c408b72040b295 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130712b915b6c704139b0c408b72040b295 2023-03-20 10:53:49,296 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/4195da4b31c7428e9c4782c88bce4246 2023-03-20 10:53:49,308 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/4195da4b31c7428e9c4782c88bce4246 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4195da4b31c7428e9c4782c88bce4246 2023-03-20 10:53:49,317 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4195da4b31c7428e9c4782c88bce4246, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-20 10:53:49,326 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 690ms, sequenceid=5, compaction requested=false 2023-03-20 10:53:49,328 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:49,332 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:49,333 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:49,333 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:49,333 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:49,333 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,333 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:49,333 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:49,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,335 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:49,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:49,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:49,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:49,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:49,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:49,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:49,341 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:49,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b357a8f[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:49,341 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,352 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,352 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:49,352 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:49,352 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:49,352 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:49,358 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:49,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,358 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:49,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:49,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:49,358 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:49,362 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:49,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:49,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:49,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:49,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,362 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:49,368 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,368 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:49,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:49,368 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:49,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:49,370 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,372 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,384 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,390 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,390 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:49,390 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:49,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:49,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:49,391 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:49,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:49,405 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:49,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:49,405 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,407 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,407 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,407 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,407 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:49,407 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:49,507 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:49,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:49,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:49,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:49,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,539 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:49,539 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:49,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:49,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:49,541 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,541 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,549 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:49,549 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:49,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:49,550 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:49,550 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:49,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:49,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,551 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,551 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:49,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:49,552 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:49,552 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:49,552 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:49,552 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:49,552 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:53:49,624 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112885f6bf334c334931ba214bf19fea0c71 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112885f6bf334c334931ba214bf19fea0c71 2023-03-20 10:53:50,069 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf 2023-03-20 10:53:50,081 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf 2023-03-20 10:53:50,092 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:53:50,096 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 544ms, sequenceid=9, compaction requested=false 2023-03-20 10:53:50,096 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:50,096 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:50,099 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:50,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:50,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bdc3e3f[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:50,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:50,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,102 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:50,102 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:50,102 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:50,102 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,102 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:50,104 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,104 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:50,104 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:50,105 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:50,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:50,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:50,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:50,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:50,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:50,118 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:50,118 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:50,118 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:50,118 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,118 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:50,119 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,119 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:50,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,120 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:50,120 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,122 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:50,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:50,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,125 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,125 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:50,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:50,126 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:50,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:50,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:50,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-20 10:53:50,127 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:50,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:50,127 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:50,228 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:50,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:50,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,251 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:50,251 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:50,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:50,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:50,253 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,253 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,254 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:50,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:50,254 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:50,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:50,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:50,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,262 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:50,262 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:50,263 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:50,278 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:50,278 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:50,278 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:50,278 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:50,278 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:50,354 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201afa5c234502a4bd68263a26f4f8d3a28 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201afa5c234502a4bd68263a26f4f8d3a28 2023-03-20 10:53:50,719 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-20 10:53:50,720 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-20 10:53:50,776 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/be145b4970744b90b0e19795a9908a82 2023-03-20 10:53:50,789 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/be145b4970744b90b0e19795a9908a82 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/be145b4970744b90b0e19795a9908a82 2023-03-20 10:53:50,798 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/be145b4970744b90b0e19795a9908a82, entries=1, sequenceid=13, filesize=5.0 K 2023-03-20 10:53:50,799 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 521ms, sequenceid=13, compaction requested=true 2023-03-20 10:53:50,800 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:50,800 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:50,800 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:50,800 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:50,800 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,800 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:50,800 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:50,802 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,802 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:50,803 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,803 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:50,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:50,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f9554b9[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:50,805 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:50,805 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,806 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,806 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:50,806 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:50,806 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,806 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:50,806 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:50,807 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:50,807 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,808 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:50,808 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:50,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:50,811 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:50,811 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:50,811 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:50,811 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,811 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:50,826 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,826 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,826 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:50,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:50,827 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,831 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:50,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:50,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:50,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:50,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:50,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:50,837 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:50,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:50,838 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:50,838 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:50,838 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-20 10:53:50,839 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,839 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,939 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:50,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:50,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:50,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,958 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:50,958 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:50,958 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:50,958 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:50,971 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,971 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,972 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:50,972 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:50,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:50,973 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:50,973 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,976 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:50,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:50,976 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:50,976 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:50,977 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:50,977 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:50,977 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:50,977 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:50,977 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:50,977 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:51,060 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ad37b680aa3d455bb678d4434abefbcf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad37b680aa3d455bb678d4434abefbcf 2023-03-20 10:53:51,082 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/b5fab75ec7054990ab5d2eab015a90e9 2023-03-20 10:53:51,103 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/b5fab75ec7054990ab5d2eab015a90e9 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/b5fab75ec7054990ab5d2eab015a90e9 2023-03-20 10:53:51,114 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/b5fab75ec7054990ab5d2eab015a90e9, entries=1, sequenceid=17, filesize=5.0 K 2023-03-20 10:53:51,116 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 139ms, sequenceid=17, compaction requested=true 2023-03-20 10:53:51,116 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:51,116 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:51,116 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:51,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:51,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:51,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:51,119 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,119 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:51,120 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,120 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:51,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:51,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:51,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39fbee21[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:51,123 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:51,123 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,124 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:51,124 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:51,124 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,124 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:51,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:51,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:51,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:51,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:51,136 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:51,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:51,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:51,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,136 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:51,144 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,144 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:51,144 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:51,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:51,151 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:51,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,167 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,177 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,177 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:51,178 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:51,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:51,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:51,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:51,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:51,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,179 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,179 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:51,179 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:51,179 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:51,279 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:51,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:51,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:51,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:51,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,300 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:51,300 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:51,301 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:51,301 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:51,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,307 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,307 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:51,307 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,307 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,309 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:51,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,309 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:51,309 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:51,310 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:51,311 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:51,311 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:51,311 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:51,370 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bdb362f6306540aabf47da7ddd6a8386 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228bdb362f6306540aabf47da7ddd6a8386 2023-03-20 10:53:51,561 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:53:51,743 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-20 10:53:51,744 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-20 10:53:51,788 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/1c69dc35ff694599aa5ae9e031fdc3bb 2023-03-20 10:53:51,803 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/1c69dc35ff694599aa5ae9e031fdc3bb as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/1c69dc35ff694599aa5ae9e031fdc3bb 2023-03-20 10:53:51,844 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/1c69dc35ff694599aa5ae9e031fdc3bb, entries=1, sequenceid=21, filesize=5.0 K 2023-03-20 10:53:51,847 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 536ms, sequenceid=21, compaction requested=true 2023-03-20 10:53:51,848 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:51,848 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:51,848 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:51,848 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:51,848 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:51,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:51,861 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,861 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:51,862 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,862 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:51,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:51,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:51,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:51,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@391a0a93[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:51,878 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:51,878 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,883 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,884 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:51,884 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:51,884 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:51,886 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,886 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:51,887 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:51,887 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:51,887 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:51,888 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:51,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:51,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:51,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:51,933 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:51,933 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:51,933 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:51,933 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,933 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:51,946 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:51,946 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,948 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:51,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,948 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,948 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:51,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:51,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:51,952 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,954 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:51,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-20 10:53:51,952 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:51,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:51,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:51,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:51,954 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:51,958 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:51,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:52,059 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:52,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:52,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:52,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:52,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,099 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:52,099 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:52,099 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:52,099 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:52,105 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,105 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,106 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:52,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:52,112 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,113 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,113 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:52,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:52,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,115 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:52,116 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:52,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:52,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:52,117 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:52,117 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:52,117 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:52,117 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:52,253 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310f01c0ea6a45484484844be16949f69f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310f01c0ea6a45484484844be16949f69f 2023-03-20 10:53:52,305 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/337656e3540d456eaa17a40331017e12 2023-03-20 10:53:52,339 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/337656e3540d456eaa17a40331017e12 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/337656e3540d456eaa17a40331017e12 2023-03-20 10:53:52,387 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/337656e3540d456eaa17a40331017e12, entries=1, sequenceid=25, filesize=5.0 K 2023-03-20 10:53:52,389 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 272ms, sequenceid=25, compaction requested=true 2023-03-20 10:53:52,389 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:52,389 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:52,389 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:52,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:52,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:52,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:52,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,393 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,393 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:52,393 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:52,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:52,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@535de649[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:52,402 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:52,402 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,406 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,408 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:52,408 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:52,408 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:52,409 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,410 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:52,418 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,418 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:52,418 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:52,419 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:52,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:52,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:52,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:52,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:52,427 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:52,427 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:52,427 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:52,427 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,427 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:52,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:52,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:52,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,430 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,433 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:52,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:52,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:52,444 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:52,444 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:52,447 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:52,447 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:52,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:52,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:52,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:52,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:52,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-20 10:53:52,545 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:52,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:52,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:52,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:52,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,594 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:52,594 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:52,595 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:52,595 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:52,596 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,596 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,597 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:52,597 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,598 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:52,602 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:52,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,603 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,618 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:52,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:52,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:52,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:52,623 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:52,645 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:52,645 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:52,658 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:52,658 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:52,658 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:53,178 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b631147cc3cc4986ba21d7fc84f14513 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101b631147cc3cc4986ba21d7fc84f14513 2023-03-20 10:53:53,631 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/c8eff86680ce4650b0e3ef07a5cc7386 2023-03-20 10:53:53,645 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/c8eff86680ce4650b0e3ef07a5cc7386 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/c8eff86680ce4650b0e3ef07a5cc7386 2023-03-20 10:53:53,661 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/c8eff86680ce4650b0e3ef07a5cc7386, entries=1, sequenceid=29, filesize=5.0 K 2023-03-20 10:53:53,665 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 1007ms, sequenceid=29, compaction requested=true 2023-03-20 10:53:53,666 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:53,666 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:53,666 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:53,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:53,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:53,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:53,668 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,669 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,669 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:53,670 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6384007[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:53,678 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:53,678 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,679 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,680 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:53,680 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:53,680 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:53,684 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:53,684 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,684 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:53,684 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:53,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:53,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:53,685 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:53,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:53,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:53,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,685 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:53,692 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,692 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,692 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:53,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:53,700 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:53,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,711 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,722 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:53,722 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:53,725 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:53,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:53,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:53,725 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,725 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:53,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:53,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:53,726 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-20 10:53:53,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:53,829 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:53,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:53,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:53,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:53,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,861 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:53,861 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:53,862 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:53,862 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:53,863 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,863 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,866 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:53,867 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:53,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:53,867 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:53,867 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,872 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,874 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:53,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:53,874 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:53,874 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:53,875 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:53,882 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:53,882 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:53,882 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:53,882 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:53,883 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:53,961 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010392fb9c3e6f504600ab892bcd0a597c17 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010392fb9c3e6f504600ab892bcd0a597c17 2023-03-20 10:53:53,995 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/113775421532414f85ee6bfe55624a19 2023-03-20 10:53:54,008 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/113775421532414f85ee6bfe55624a19 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/113775421532414f85ee6bfe55624a19 2023-03-20 10:53:54,019 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/113775421532414f85ee6bfe55624a19, entries=1, sequenceid=33, filesize=5.0 K 2023-03-20 10:53:54,020 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 137ms, sequenceid=33, compaction requested=true 2023-03-20 10:53:54,020 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:54,020 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:54,020 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:54,021 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:54,021 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,021 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:54,021 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:54,022 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,022 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:54,023 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,023 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60542c07[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:54,024 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:54,024 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,025 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,025 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:54,025 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,026 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:54,025 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:54,026 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:54,032 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:54,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,033 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:54,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:54,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:54,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:54,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:54,036 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:54,036 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:54,036 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:54,036 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,036 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:54,037 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,037 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:54,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:54,037 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:54,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:54,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:54,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:54,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,042 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,046 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:54,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,051 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:54,051 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:54,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:54,051 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,051 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,051 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:54,051 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:54,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:54,052 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,052 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,052 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,052 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,053 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:54,053 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:54,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:54,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:54,153 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:54,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:54,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:54,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,178 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:54,178 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:54,179 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:54,179 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:54,179 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,180 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:54,181 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:54,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:54,181 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:54,182 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:54,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:54,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,192 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:54,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:54,192 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:54,192 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:54,193 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:54,194 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:54,194 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:54,194 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:54,194 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:54,194 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:54,644 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cb63236c015d467c9a4ca62cdb25a9ee to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907cb63236c015d467c9a4ca62cdb25a9ee 2023-03-20 10:53:55,071 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/4eb12a15d5e24780933abc3ca1c3ded2 2023-03-20 10:53:55,083 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/4eb12a15d5e24780933abc3ca1c3ded2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4eb12a15d5e24780933abc3ca1c3ded2 2023-03-20 10:53:55,092 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4eb12a15d5e24780933abc3ca1c3ded2, entries=1, sequenceid=37, filesize=5.0 K 2023-03-20 10:53:55,094 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 900ms, sequenceid=37, compaction requested=true 2023-03-20 10:53:55,094 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:55,094 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:55,094 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:55,095 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:55,095 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,095 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:55,095 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:55,099 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,099 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:55,100 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,100 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:55,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:55,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:55,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:55,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:55,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f3ec0c[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:55,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:55,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,102 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:55,102 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:55,102 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:55,102 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,103 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:55,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:55,103 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:55,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:55,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:55,106 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:55,106 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:55,107 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:55,107 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,107 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:55,125 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,125 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:55,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,127 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,128 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,130 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:55,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:55,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:55,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:55,131 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:55,131 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:55,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:55,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:55,231 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:55,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:55,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:53:55,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-20 10:53:55,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,248 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:55,248 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:55,249 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-20 10:53:55,249 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-20 10:53:55,249 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,250 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,254 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:55,254 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:55,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:53:55,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:53:55,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-20 10:53:55,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,256 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-20 10:53:55,256 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:53:55,258 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-20 10:53:55,258 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:53:55,258 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:53:55,258 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:55,258 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. started... 2023-03-20 10:53:55,258 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b297fedee688520fa896c9eed857babd 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:53:55,289 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b902e96a45394c08b19bf526f48e091e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b902e96a45394c08b19bf526f48e091e 2023-03-20 10:53:55,716 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/5fce06e0568a495ab9a27f628c3d2c4a 2023-03-20 10:53:55,725 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/5fce06e0568a495ab9a27f628c3d2c4a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/5fce06e0568a495ab9a27f628c3d2c4a 2023-03-20 10:53:55,733 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/5fce06e0568a495ab9a27f628c3d2c4a, entries=1, sequenceid=41, filesize=5.0 K 2023-03-20 10:53:55,734 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b297fedee688520fa896c9eed857babd in 476ms, sequenceid=41, compaction requested=true 2023-03-20 10:53:55,735 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:55,735 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:55,735 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:53:55,735 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:53:55,735 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,736 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-20 10:53:55,736 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-20 10:53:55,737 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,737 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,738 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:53:55,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:55,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-20 10:53:55,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35202cd5[Count = 0] remaining members to acquire global barrier 2023-03-20 10:53:55,745 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-20 10:53:55,745 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,760 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,760 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-20 10:53:55,761 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-20 10:53:55,761 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,761 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:53:55,761 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:53:55,762 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,762 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-20 10:53:55,762 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:55,762 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-20 10:53:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:53:55,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-20 10:53:55,765 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-20 10:53:55,765 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:53:55,765 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:53:55,765 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,765 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:53:55,767 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,767 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,767 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:53:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:53:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:53:55,768 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:53:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,770 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:53:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:53:55,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:53:55,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:53:55,773 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:53:55,773 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,773 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-20 10:53:55,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:53:55,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:53:55,773 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:53:55,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:53:55,773 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:55,774 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,774 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,774 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,774 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-20 10:53:55,774 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:53:55,874 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:53:55,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:53:55,885 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-20 10:53:55,888 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38922, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-20 10:53:55,890 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:55,904 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-20 10:53:55,905 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-20 10:53:55,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:53:55,907 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310235907 2023-03-20 10:53:55,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:53:55,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-20 10:53:55,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:55,917 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x545e4385 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:53:55,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3986b9bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:53:55,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,129 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103041c6beca82d4589949b8b284bdfc09d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103041c6beca82d4589949b8b284bdfc09d 2023-03-20 10:53:56,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:56,162 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:53:56,164 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:53:56,211 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:53:56,214 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:53:56,308 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49902b9559d6455aaf934167c9871a0b first=Optional[r3] last=Optional[r6] 2023-03-20 10:53:56,328 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49902b9559d6455aaf934167c9871a0b}] 2023-03-20 10:53:56,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49902b9559d6455aaf934167c9871a0b for inclusion in b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:56,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-20 10:53:56,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:53:56,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:56,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49902b9559d6455aaf934167c9871a0b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__cc7v5n1orf5ttlogmp12etva0q4msemqq0147i3nndpsoa4t32uunjdro25gaqkd/family1/49902b9559d6455aaf934167c9871a0b 2023-03-20 10:53:56,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__cc7v5n1orf5ttlogmp12etva0q4msemqq0147i3nndpsoa4t32uunjdro25gaqkd/family1/49902b9559d6455aaf934167c9871a0b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_ 2023-03-20 10:53:56,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__cc7v5n1orf5ttlogmp12etva0q4msemqq0147i3nndpsoa4t32uunjdro25gaqkd/family1/49902b9559d6455aaf934167c9871a0b into b297fedee688520fa896c9eed857babd/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_ - updating store file list. 2023-03-20 10:53:56,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_ into b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:56,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__cc7v5n1orf5ttlogmp12etva0q4msemqq0147i3nndpsoa4t32uunjdro25gaqkd/family1/49902b9559d6455aaf934167c9871a0b into b297fedee688520fa896c9eed857babd/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_) 2023-03-20 10:53:56,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__cc7v5n1orf5ttlogmp12etva0q4msemqq0147i3nndpsoa4t32uunjdro25gaqkd/family1/49902b9559d6455aaf934167c9871a0b 2023-03-20 10:53:56,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:53:56,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:53:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(1912): b297fedee688520fa896c9eed857babd/family1 is initiating minor compaction 2023-03-20 10:53:56,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19935e68; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:53:56,432 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b297fedee688520fa896c9eed857babd/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:56,434 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/be145b4970744b90b0e19795a9908a82, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/b5fab75ec7054990ab5d2eab015a90e9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/1c69dc35ff694599aa5ae9e031fdc3bb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/337656e3540d456eaa17a40331017e12, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/c8eff86680ce4650b0e3ef07a5cc7386, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/113775421532414f85ee6bfe55624a19, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4eb12a15d5e24780933abc3ca1c3ded2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/5fce06e0568a495ab9a27f628c3d2c4a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp, totalSize=50.2 K 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 2aa4b2e0fa6f4be69dc2c37c3f3c56bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting be145b4970744b90b0e19795a9908a82, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting b5fab75ec7054990ab5d2eab015a90e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 1c69dc35ff694599aa5ae9e031fdc3bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 337656e3540d456eaa17a40331017e12, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting c8eff86680ce4650b0e3ef07a5cc7386, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 113775421532414f85ee6bfe55624a19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 4eb12a15d5e24780933abc3ca1c3ded2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:53:56,435 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 5fce06e0568a495ab9a27f628c3d2c4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:53:56,436 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:53:56,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:56,450 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:53:56,458 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228bdb362f6306540aabf47da7ddd6a8386 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228bdb362f6306540aabf47da7ddd6a8386 2023-03-20 10:53:56,461 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310f01c0ea6a45484484844be16949f69f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310f01c0ea6a45484484844be16949f69f 2023-03-20 10:53:56,463 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101b631147cc3cc4986ba21d7fc84f14513 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101b631147cc3cc4986ba21d7fc84f14513 2023-03-20 10:53:56,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010392fb9c3e6f504600ab892bcd0a597c17 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010392fb9c3e6f504600ab892bcd0a597c17 2023-03-20 10:53:56,468 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-20 10:53:56,468 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-20 10:53:56,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,584 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): b297fedee688520fa896c9eed857babd#family1#compaction#10 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:53:56,742 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/cb38420979f349aa8eeddbfd38f675e8 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/cb38420979f349aa8eeddbfd38f675e8 2023-03-20 10:53:56,747 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f48541df50694d15ae63aec213d2fff8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f48541df50694d15ae63aec213d2fff8 2023-03-20 10:53:56,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:56,784 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b297fedee688520fa896c9eed857babd/family1 of b297fedee688520fa896c9eed857babd into cb38420979f349aa8eeddbfd38f675e8(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:53:56,787 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:56,789 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1679309636421; duration=0sec 2023-03-20 10:53:56,790 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:53:56,855 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/be1297b895f24213a03985e77e591cec first=Optional[r00] last=Optional[r2] 2023-03-20 10:53:56,856 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/be1297b895f24213a03985e77e591cec}] 2023-03-20 10:53:56,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/be1297b895f24213a03985e77e591cec for inclusion in b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:56,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-20 10:53:56,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:53:56,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:56,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/be1297b895f24213a03985e77e591cec to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ftt6d4bi1e074ii3j303kngk8723p23jn5onf3i2anfqih6cvs0rnr4sn3ojnve1/family1/be1297b895f24213a03985e77e591cec 2023-03-20 10:53:56,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ftt6d4bi1e074ii3j303kngk8723p23jn5onf3i2anfqih6cvs0rnr4sn3ojnve1/family1/be1297b895f24213a03985e77e591cec as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_ 2023-03-20 10:53:56,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/be145b4970744b90b0e19795a9908a82, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/b5fab75ec7054990ab5d2eab015a90e9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/1c69dc35ff694599aa5ae9e031fdc3bb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/337656e3540d456eaa17a40331017e12, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/c8eff86680ce4650b0e3ef07a5cc7386, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/113775421532414f85ee6bfe55624a19, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4eb12a15d5e24780933abc3ca1c3ded2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/5fce06e0568a495ab9a27f628c3d2c4a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_] to archive 2023-03-20 10:53:56,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:53:56,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ftt6d4bi1e074ii3j303kngk8723p23jn5onf3i2anfqih6cvs0rnr4sn3ojnve1/family1/be1297b895f24213a03985e77e591cec into b297fedee688520fa896c9eed857babd/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_ - updating store file list. 2023-03-20 10:53:56,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/2aa4b2e0fa6f4be69dc2c37c3f3c56bf 2023-03-20 10:53:56,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/be145b4970744b90b0e19795a9908a82 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/be145b4970744b90b0e19795a9908a82 2023-03-20 10:53:56,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/b5fab75ec7054990ab5d2eab015a90e9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/b5fab75ec7054990ab5d2eab015a90e9 2023-03-20 10:53:56,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/1c69dc35ff694599aa5ae9e031fdc3bb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/1c69dc35ff694599aa5ae9e031fdc3bb 2023-03-20 10:53:56,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_ into b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:56,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ftt6d4bi1e074ii3j303kngk8723p23jn5onf3i2anfqih6cvs0rnr4sn3ojnve1/family1/be1297b895f24213a03985e77e591cec into b297fedee688520fa896c9eed857babd/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_) 2023-03-20 10:53:56,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/337656e3540d456eaa17a40331017e12 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/337656e3540d456eaa17a40331017e12 2023-03-20 10:53:56,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/c8eff86680ce4650b0e3ef07a5cc7386 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/c8eff86680ce4650b0e3ef07a5cc7386 2023-03-20 10:53:56,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ftt6d4bi1e074ii3j303kngk8723p23jn5onf3i2anfqih6cvs0rnr4sn3ojnve1/family1/be1297b895f24213a03985e77e591cec 2023-03-20 10:53:56,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:53:56,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/113775421532414f85ee6bfe55624a19 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/113775421532414f85ee6bfe55624a19 2023-03-20 10:53:56,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4eb12a15d5e24780933abc3ca1c3ded2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4eb12a15d5e24780933abc3ca1c3ded2 2023-03-20 10:53:56,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/5fce06e0568a495ab9a27f628c3d2c4a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/5fce06e0568a495ab9a27f628c3d2c4a 2023-03-20 10:53:56,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:53:56,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(1912): b297fedee688520fa896c9eed857babd/family1 is initiating minor compaction (all files) 2023-03-20 10:53:56,938 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b297fedee688520fa896c9eed857babd/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:56,938 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4195da4b31c7428e9c4782c88bce4246, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/cb38420979f349aa8eeddbfd38f675e8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp, totalSize=358.6 K 2023-03-20 10:53:56,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@34494a91; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:53:56,941 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 4195da4b31c7428e9c4782c88bce4246, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:53:56,945 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting cb38420979f349aa8eeddbfd38f675e8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:53:56,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:56,946 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 8c6bddeab26c47938dcf274f0c63defb_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878847712 2023-03-20 10:53:56,948 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:53:56,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/dfc0acedeffe4e6d9a3b9b85d3cbeb13_SeqId_44_ 2023-03-20 10:53:56,959 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130712b915b6c704139b0c408b72040b295 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130712b915b6c704139b0c408b72040b295 2023-03-20 10:53:56,963 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201afa5c234502a4bd68263a26f4f8d3a28 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201afa5c234502a4bd68263a26f4f8d3a28 2023-03-20 10:53:56,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad37b680aa3d455bb678d4434abefbcf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad37b680aa3d455bb678d4434abefbcf 2023-03-20 10:53:56,967 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-20 10:53:56,967 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-20 10:53:56,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:56,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:56,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:53:57,008 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-20 10:53:57,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.1130 sec 2023-03-20 10:53:57,146 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): b297fedee688520fa896c9eed857babd#family1#compaction#11 average throughput is 1.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:53:57,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-20 10:53:57,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:57,590 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-20 10:53:57,592 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-20 10:53:57,592 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-20 10:53:57,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-20 10:53:57,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, REOPEN/MOVE}] 2023-03-20 10:53:57,620 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, REOPEN/MOVE 2023-03-20 10:53:57,623 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b297fedee688520fa896c9eed857babd, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:57,623 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309637623"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309637623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309637623"}]},"ts":"1679309637623"} 2023-03-20 10:53:57,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure b297fedee688520fa896c9eed857babd, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:53:57,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b297fedee688520fa896c9eed857babd 2023-03-20 10:53:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b297fedee688520fa896c9eed857babd, disabling compactions & flushes 2023-03-20 10:53:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,096 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/.tmp/family1/9ff309f7287843a78f85d98eb7885d04 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/9ff309f7287843a78f85d98eb7885d04 2023-03-20 10:53:58,110 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b297fedee688520fa896c9eed857babd/family1 of b297fedee688520fa896c9eed857babd into 9ff309f7287843a78f85d98eb7885d04(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:53:58,110 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:58,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. after waiting 0 ms 2023-03-20 10:53:58,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,110 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1679309636937; duration=1sec 2023-03-20 10:53:58,110 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:53:58,113 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4195da4b31c7428e9c4782c88bce4246, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/cb38420979f349aa8eeddbfd38f675e8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_] to archive 2023-03-20 10:53:58,114 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:53:58,118 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4195da4b31c7428e9c4782c88bce4246 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/4195da4b31c7428e9c4782c88bce4246 2023-03-20 10:53:58,120 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/cb38420979f349aa8eeddbfd38f675e8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/cb38420979f349aa8eeddbfd38f675e8 2023-03-20 10:53:58,122 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/8c6bddeab26c47938dcf274f0c63defb_SeqId_47_ 2023-03-20 10:53:58,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-20 10:53:58,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:58,131 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b297fedee688520fa896c9eed857babd to self. 2023-03-20 10:53:58,135 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b297fedee688520fa896c9eed857babd, regionState=CLOSED 2023-03-20 10:53:58,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,135 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309638135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309638135"}]},"ts":"1679309638135"} 2023-03-20 10:53:58,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-20 10:53:58,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure b297fedee688520fa896c9eed857babd, server=jenkins-hbase20.apache.org,44189,1679309623230 in 510 msec 2023-03-20 10:53:58,141 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=true 2023-03-20 10:53:58,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b297fedee688520fa896c9eed857babd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:58,292 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309638292"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309638292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309638292"}]},"ts":"1679309638292"} 2023-03-20 10:53:58,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure b297fedee688520fa896c9eed857babd, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:53:58,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b297fedee688520fa896c9eed857babd, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:53:58,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:53:58,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,453 INFO [StoreOpener-b297fedee688520fa896c9eed857babd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,454 DEBUG [StoreOpener-b297fedee688520fa896c9eed857babd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:58,454 DEBUG [StoreOpener-b297fedee688520fa896c9eed857babd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:58,455 INFO [StoreOpener-b297fedee688520fa896c9eed857babd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b297fedee688520fa896c9eed857babd columnFamilyName family1 2023-03-20 10:53:58,467 DEBUG [StoreOpener-b297fedee688520fa896c9eed857babd-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/9ff309f7287843a78f85d98eb7885d04 2023-03-20 10:53:58,468 INFO [StoreOpener-b297fedee688520fa896c9eed857babd-1] regionserver.HStore(310): Store=b297fedee688520fa896c9eed857babd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:53:58,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b297fedee688520fa896c9eed857babd 2023-03-20 10:53:58,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b297fedee688520fa896c9eed857babd; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71344377, jitterRate=0.06311406195163727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:53:58,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:58,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., pid=17, masterSystemTime=1679309638447 2023-03-20 10:53:58,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:53:58,478 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b297fedee688520fa896c9eed857babd, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:53:58,478 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679309638477"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309638477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309638477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309638477"}]},"ts":"1679309638477"} 2023-03-20 10:53:58,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-20 10:53:58,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure b297fedee688520fa896c9eed857babd, server=jenkins-hbase20.apache.org,44189,1679309623230 in 186 msec 2023-03-20 10:53:58,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-20 10:53:58,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b297fedee688520fa896c9eed857babd, REOPEN/MOVE in 865 msec 2023-03-20 10:53:58,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-20 10:53:58,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 887 msec 2023-03-20 10:53:58,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 971 msec 2023-03-20 10:53:58,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-20 10:53:58,497 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(278): alter status finished 2023-03-20 10:53:58,498 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-20 10:53:58,500 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-20 10:53:58,501 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-20 10:53:58,502 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:53:58,502 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310238502 2023-03-20 10:53:58,503 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:53:58,504 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-20 10:53:58,504 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:58,505 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x1ca23dc6 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:53:58,517 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9546a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:53:58,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:58,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:58,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:58,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:58,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:58,958 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b3d7d9081afa48c1acf6a6da9e8e637d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128b3d7d9081afa48c1acf6a6da9e8e637d 2023-03-20 10:53:58,960 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:58,977 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:53:58,979 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:53:58,995 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:53:58,997 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:53:59,021 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c5ab1c6f08048c8bbd5cb638555172e first=Optional[r05] last=Optional[r8] 2023-03-20 10:53:59,026 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c5ab1c6f08048c8bbd5cb638555172e}] 2023-03-20 10:53:59,037 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c5ab1c6f08048c8bbd5cb638555172e for inclusion in b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:59,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-20 10:53:59,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:53:59,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:53:59,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c5ab1c6f08048c8bbd5cb638555172e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3lr7h0b7ri0b329e6g9l0dkfcibc7lds21qtlsgg6humtls7s5r8pi6ep1naqsd6/family1/1c5ab1c6f08048c8bbd5cb638555172e 2023-03-20 10:53:59,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3lr7h0b7ri0b329e6g9l0dkfcibc7lds21qtlsgg6humtls7s5r8pi6ep1naqsd6/family1/1c5ab1c6f08048c8bbd5cb638555172e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/002c0549d138414f84244e982fcf8a1e_SeqId_53_ 2023-03-20 10:53:59,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3lr7h0b7ri0b329e6g9l0dkfcibc7lds21qtlsgg6humtls7s5r8pi6ep1naqsd6/family1/1c5ab1c6f08048c8bbd5cb638555172e into b297fedee688520fa896c9eed857babd/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/002c0549d138414f84244e982fcf8a1e_SeqId_53_ - updating store file list. 2023-03-20 10:53:59,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/002c0549d138414f84244e982fcf8a1e_SeqId_53_ into b297fedee688520fa896c9eed857babd/family1 2023-03-20 10:53:59,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3lr7h0b7ri0b329e6g9l0dkfcibc7lds21qtlsgg6humtls7s5r8pi6ep1naqsd6/family1/1c5ab1c6f08048c8bbd5cb638555172e into b297fedee688520fa896c9eed857babd/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/family1/002c0549d138414f84244e982fcf8a1e_SeqId_53_) 2023-03-20 10:53:59,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3lr7h0b7ri0b329e6g9l0dkfcibc7lds21qtlsgg6humtls7s5r8pi6ep1naqsd6/family1/1c5ab1c6f08048c8bbd5cb638555172e 2023-03-20 10:53:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:59,061 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:53:59,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b902e96a45394c08b19bf526f48e091e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b902e96a45394c08b19bf526f48e091e 2023-03-20 10:53:59,066 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112885f6bf334c334931ba214bf19fea0c71 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112885f6bf334c334931ba214bf19fea0c71 2023-03-20 10:53:59,066 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-20 10:53:59,066 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-20 10:53:59,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:59,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:59,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-20 10:53:59,067 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-20 10:53:59,067 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:53:59,068 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-20 10:53:59,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 569 msec 2023-03-20 10:53:59,169 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=249 (was 211) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34534 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1204379180_15 at /127.0.0.1:34470 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x38609e2f-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34558 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x38609e2f-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34524 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34556 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x38609e2f-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404c66ff-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34528 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34490 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x545e4385-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x545e4385 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/823502472.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404c66ff-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34352 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34632 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34420 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404c66ff-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34582 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x545e4385-SendThread(127.0.0.1:62837) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:44189-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34386 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x1ca23dc6-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x1ca23dc6-SendThread(127.0.0.1:62837) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x1ca23dc6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/823502472.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404c66ff-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34538 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404c66ff-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34442 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=592 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=877 (was 794) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 186), AvailableMemoryMB=9545 (was 9617) 2023-03-20 10:53:59,182 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=877, ProcessCount=186, AvailableMemoryMB=9544 2023-03-20 10:53:59,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-20 10:53:59,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-20 10:53:59,187 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:53:59,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-20 10:53:59,188 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:53:59,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-20 10:53:59,191 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531 2023-03-20 10:53:59,191 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531 empty. 2023-03-20 10:53:59,192 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531 2023-03-20 10:53:59,192 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-20 10:53:59,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-20 10:53:59,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-20 10:53:59,602 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-20 10:53:59,608 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => cb051e8df6af553f31841872b29bc531, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:53:59,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-20 10:54:00,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:00,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing cb051e8df6af553f31841872b29bc531, disabling compactions & flushes 2023-03-20 10:54:00,029 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. after waiting 0 ms 2023-03-20 10:54:00,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,029 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:00,032 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:54:00,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679309640033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309640033"}]},"ts":"1679309640033"} 2023-03-20 10:54:00,036 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:54:00,037 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:54:00,037 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309640037"}]},"ts":"1679309640037"} 2023-03-20 10:54:00,039 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-20 10:54:00,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cb051e8df6af553f31841872b29bc531, ASSIGN}] 2023-03-20 10:54:00,043 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cb051e8df6af553f31841872b29bc531, ASSIGN 2023-03-20 10:54:00,045 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cb051e8df6af553f31841872b29bc531, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:00,196 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=cb051e8df6af553f31841872b29bc531, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:00,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679309640196"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309640196"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309640196"}]},"ts":"1679309640196"} 2023-03-20 10:54:00,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure cb051e8df6af553f31841872b29bc531, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-20 10:54:00,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb051e8df6af553f31841872b29bc531, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:00,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:00,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,367 INFO [StoreOpener-cb051e8df6af553f31841872b29bc531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,370 DEBUG [StoreOpener-cb051e8df6af553f31841872b29bc531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:00,370 DEBUG [StoreOpener-cb051e8df6af553f31841872b29bc531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:00,370 INFO [StoreOpener-cb051e8df6af553f31841872b29bc531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb051e8df6af553f31841872b29bc531 columnFamilyName family1 2023-03-20 10:54:00,373 INFO [StoreOpener-cb051e8df6af553f31841872b29bc531-1] regionserver.HStore(310): Store=cb051e8df6af553f31841872b29bc531/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:00,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cb051e8df6af553f31841872b29bc531 2023-03-20 10:54:00,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:00,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cb051e8df6af553f31841872b29bc531; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65209601, jitterRate=-0.02830122411251068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:00,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:00,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531., pid=21, masterSystemTime=1679309640360 2023-03-20 10:54:00,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:00,384 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=cb051e8df6af553f31841872b29bc531, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:00,384 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679309640384"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309640384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309640384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309640384"}]},"ts":"1679309640384"} 2023-03-20 10:54:00,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-20 10:54:00,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure cb051e8df6af553f31841872b29bc531, server=jenkins-hbase20.apache.org,44189,1679309623230 in 183 msec 2023-03-20 10:54:00,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-20 10:54:00,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cb051e8df6af553f31841872b29bc531, ASSIGN in 348 msec 2023-03-20 10:54:00,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:54:00,395 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309640395"}]},"ts":"1679309640395"} 2023-03-20 10:54:00,397 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-20 10:54:00,403 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:54:00,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2190 sec 2023-03-20 10:54:01,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-20 10:54:01,297 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-20 10:54:01,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:01,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,340 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:01,340 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:01,341 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:01,341 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:01,341 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,341 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:01,342 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:01,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:01,343 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,343 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,343 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,344 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:01,344 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:01,345 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:01,345 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:01,345 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:01,345 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:01,345 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:01,346 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:54:01,394 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c5e41320e26e46ae927565727a69b276 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130c5e41320e26e46ae927565727a69b276 2023-03-20 10:54:01,408 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/136b23e8e6d04db89d1693943ce320d1 2023-03-20 10:54:01,429 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/136b23e8e6d04db89d1693943ce320d1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/136b23e8e6d04db89d1693943ce320d1 2023-03-20 10:54:01,446 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/136b23e8e6d04db89d1693943ce320d1, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-20 10:54:01,448 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 102ms, sequenceid=5, compaction requested=false 2023-03-20 10:54:01,448 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:01,450 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:01,450 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:01,450 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:01,450 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:01,450 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,450 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:01,450 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:01,455 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,455 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:01,456 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,456 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:01,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:01,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:01,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:01,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71dc7a0e[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:01,482 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:01,482 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,490 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,490 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:01,490 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:01,490 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:01,498 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,498 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:01,501 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:01,501 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,501 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:01,501 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:01,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:01,505 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:01,505 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:01,505 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:01,505 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,505 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:01,509 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,509 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,509 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:01,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,510 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:01,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,520 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:01,520 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:01,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:01,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:01,521 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:01,521 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:01,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:01,621 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:01,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:01,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,633 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:01,633 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:01,634 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:01,634 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:01,635 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,635 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,636 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:01,636 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:01,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:01,636 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:01,637 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:01,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,637 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,638 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:01,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:01,638 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:01,638 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:01,638 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:01,638 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:01,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:01,639 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:01,639 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:01,639 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:54:02,058 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f12e61077c784e9a9fbc0811831d40f4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f12e61077c784e9a9fbc0811831d40f4 2023-03-20 10:54:02,519 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/389c9105a0b9472d95d24eff224af7e1 2023-03-20 10:54:02,528 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/389c9105a0b9472d95d24eff224af7e1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/389c9105a0b9472d95d24eff224af7e1 2023-03-20 10:54:02,545 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/389c9105a0b9472d95d24eff224af7e1, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:54:02,547 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 908ms, sequenceid=9, compaction requested=false 2023-03-20 10:54:02,548 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:02,548 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:02,548 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:02,548 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:02,548 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,548 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:02,548 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:02,549 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,549 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:02,550 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,550 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:02,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:02,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30a95426[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:02,552 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:02,552 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,553 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,554 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:02,554 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:02,554 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,554 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:02,554 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:02,555 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:02,555 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,555 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:02,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:02,555 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:02,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:02,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:02,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:02,559 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:02,559 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:02,559 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:02,559 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,559 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:02,567 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,567 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,568 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:02,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:02,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:02,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:02,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,574 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,578 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,581 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,581 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:02,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:02,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:02,581 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,581 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:02,582 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,582 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,582 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,582 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,582 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:02,581 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:02,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:02,583 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:02,583 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:02,683 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:02,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:02,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:02,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:02,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,701 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:02,701 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:02,704 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:02,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:02,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,706 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,706 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:02,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:02,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:02,706 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,707 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,707 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:02,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,708 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:02,708 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:02,708 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:02,709 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:02,709 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:02,709 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:02,709 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:02,709 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:02,746 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120131f49efa1fdc4177bfe2911352560c87 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120131f49efa1fdc4177bfe2911352560c87 2023-03-20 10:54:02,788 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/cd645e73fc324c578bc69b85a50b626f 2023-03-20 10:54:02,803 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/cd645e73fc324c578bc69b85a50b626f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/cd645e73fc324c578bc69b85a50b626f 2023-03-20 10:54:02,812 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/cd645e73fc324c578bc69b85a50b626f, entries=1, sequenceid=13, filesize=4.9 K 2023-03-20 10:54:02,813 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 104ms, sequenceid=13, compaction requested=true 2023-03-20 10:54:02,813 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:02,813 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:02,814 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:02,814 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:02,814 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,814 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:02,814 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:02,816 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,816 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:02,817 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,817 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:02,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:02,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26ac4db3[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:02,828 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:02,828 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,834 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,834 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,834 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:02,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,842 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:02,842 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:02,842 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:02,854 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:02,854 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:02,855 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:02,855 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:02,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:02,863 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:02,863 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:02,863 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:02,863 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,863 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:02,866 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,866 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:02,866 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:02,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,867 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,869 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:02,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:02,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:02,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:02,882 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:02,882 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:02,881 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:02,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,882 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:02,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:02,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:54:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:02,982 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:02,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:03,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:03,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:03,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,006 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:03,006 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:03,007 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:03,007 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:03,007 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,007 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,014 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,014 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,014 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:03,014 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:03,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:03,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:03,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:03,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,017 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:03,017 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:03,018 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:03,018 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:03,018 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:03,018 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:03,018 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:03,018 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:03,058 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205afa96db05a094ceb9e66031bdeba6218 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205afa96db05a094ceb9e66031bdeba6218 2023-03-20 10:54:03,073 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/ca6765d8a0f145f0974743849a7c708f 2023-03-20 10:54:03,082 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/ca6765d8a0f145f0974743849a7c708f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ca6765d8a0f145f0974743849a7c708f 2023-03-20 10:54:03,091 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ca6765d8a0f145f0974743849a7c708f, entries=1, sequenceid=17, filesize=4.9 K 2023-03-20 10:54:03,093 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 75ms, sequenceid=17, compaction requested=true 2023-03-20 10:54:03,093 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:03,093 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:03,093 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:03,093 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:03,093 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,093 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:03,093 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:03,095 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,095 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,096 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:03,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@125e9b37[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:03,100 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:03,100 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,109 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,110 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,110 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:03,110 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:03,110 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:03,110 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:03,182 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:03,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:03,183 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:03,183 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:03,183 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:03,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:03,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:03,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:03,201 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:03,201 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:03,201 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:03,201 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,201 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:03,249 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:03,250 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,250 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,250 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:03,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,254 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,270 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:03,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:03,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:03,271 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,271 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,271 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,271 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,272 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:03,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:54:03,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:03,372 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:03,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:03,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:03,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:03,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,394 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:03,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:03,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:03,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:03,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,397 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:03,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,397 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,398 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,398 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:03,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:03,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:03,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,403 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:03,403 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:03,404 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:03,405 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:03,405 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:03,405 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:03,405 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:03,405 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:03,436 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228aa0bed23c46a4ef5b0a4058ac8461d80 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228aa0bed23c46a4ef5b0a4058ac8461d80 2023-03-20 10:54:03,677 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:54:03,854 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/27f6c1ca8d8248eb89cc58005c72cdd6 2023-03-20 10:54:03,879 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/27f6c1ca8d8248eb89cc58005c72cdd6 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/27f6c1ca8d8248eb89cc58005c72cdd6 2023-03-20 10:54:03,892 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/27f6c1ca8d8248eb89cc58005c72cdd6, entries=1, sequenceid=21, filesize=4.9 K 2023-03-20 10:54:03,894 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 489ms, sequenceid=21, compaction requested=true 2023-03-20 10:54:03,894 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:03,894 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:03,894 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:03,894 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:03,894 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,894 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:03,894 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:03,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:03,898 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:03,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:03,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:03,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c09f78[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:03,902 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:03,902 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,909 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,909 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:03,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:03,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:03,910 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,910 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:03,917 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:03,917 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:03,917 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:03,917 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:03,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:03,930 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:03,930 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:03,930 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:03,930 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,930 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:03,935 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,935 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:03,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,936 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:03,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,940 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,951 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:03,958 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:03,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:03,959 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:03,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:03,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:03,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:03,962 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:03,962 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:04,062 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:04,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:04,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:04,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:04,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,089 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:04,089 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:04,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:04,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:04,103 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,103 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,105 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:04,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,108 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,108 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,108 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,108 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:04,109 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:04,109 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:04,109 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:04,109 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:04,109 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:04,110 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:04,108 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:04,215 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123140dc9d27f1c94c4785fb0e911df483f6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123140dc9d27f1c94c4785fb0e911df483f6 2023-03-20 10:54:04,251 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/4c31add16bce4af9b55ed3cd1c2069e2 2023-03-20 10:54:04,274 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/4c31add16bce4af9b55ed3cd1c2069e2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/4c31add16bce4af9b55ed3cd1c2069e2 2023-03-20 10:54:04,289 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/4c31add16bce4af9b55ed3cd1c2069e2, entries=1, sequenceid=25, filesize=4.9 K 2023-03-20 10:54:04,290 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 180ms, sequenceid=25, compaction requested=true 2023-03-20 10:54:04,290 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:04,290 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:04,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:04,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:04,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:04,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:04,292 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,292 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:04,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:04,292 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,293 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:04,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:04,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:04,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:04,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ab2e322[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:04,301 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:04,301 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,303 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,303 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:04,303 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:04,303 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:04,305 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:04,305 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:04,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:04,306 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:04,306 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:04,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:04,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:04,313 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:04,313 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:04,313 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:04,313 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,313 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:04,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,318 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,318 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:04,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:04,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:04,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:04,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,321 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,327 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,332 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:04,332 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:04,332 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:04,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:04,332 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,333 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,333 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,333 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,333 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,333 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,333 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:04,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:04,334 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:04,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:04,334 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:04,434 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:04,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:04,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:04,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:04,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,445 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:04,445 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:04,446 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:04,446 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:04,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,447 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:04,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:04,448 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,448 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:04,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:04,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:04,449 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:04,449 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:04,450 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:04,454 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:04,454 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:04,454 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:04,454 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:04,454 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:04,883 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b9727a470f664964af48af87e78c6c62 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101b9727a470f664964af48af87e78c6c62 2023-03-20 10:54:05,290 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/d9234d14a86d43aabe8fff88e78842f6 2023-03-20 10:54:05,298 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/d9234d14a86d43aabe8fff88e78842f6 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/d9234d14a86d43aabe8fff88e78842f6 2023-03-20 10:54:05,303 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/d9234d14a86d43aabe8fff88e78842f6, entries=1, sequenceid=29, filesize=4.9 K 2023-03-20 10:54:05,304 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 850ms, sequenceid=29, compaction requested=true 2023-03-20 10:54:05,304 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:05,304 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:05,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:05,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:05,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:05,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:05,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,327 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:05,328 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,328 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eb7e812[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:05,330 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:05,330 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,330 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:05,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:05,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:05,331 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,331 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:05,331 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:05,336 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:05,336 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:05,336 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:05,336 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,336 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:05,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:05,359 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:05,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:05,360 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:05,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:05,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:05,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:05,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:05,367 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:05,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,369 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,369 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,369 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,370 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:05,370 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:05,370 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:05,470 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:05,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:05,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:05,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:05,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,483 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:05,483 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:05,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:05,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:05,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,485 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:05,485 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:05,485 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:05,485 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:05,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:05,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:05,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:05,487 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:05,490 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:05,490 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:05,490 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:05,490 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:05,490 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:05,905 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010312012a5a3f6a47a1b3a1ad0bd168a01c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010312012a5a3f6a47a1b3a1ad0bd168a01c 2023-03-20 10:54:06,313 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/139a38ffeaf64c2881d0cde6e73869ad 2023-03-20 10:54:06,321 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/139a38ffeaf64c2881d0cde6e73869ad as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/139a38ffeaf64c2881d0cde6e73869ad 2023-03-20 10:54:06,328 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/139a38ffeaf64c2881d0cde6e73869ad, entries=1, sequenceid=33, filesize=4.9 K 2023-03-20 10:54:06,329 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 839ms, sequenceid=33, compaction requested=true 2023-03-20 10:54:06,329 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:06,329 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:06,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:06,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:06,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:06,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:06,330 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,330 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:06,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:06,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:06,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:06,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:06,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:06,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:06,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58d64bd0[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:06,332 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:06,332 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,334 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,335 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:06,335 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:06,335 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,335 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:06,335 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:06,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:06,336 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:06,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:06,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:06,338 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:06,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:06,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:06,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,338 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:06,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:06,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:06,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:06,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,340 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,341 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,341 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,341 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:06,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:06,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:06,342 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:06,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:06,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:06,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:06,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,342 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:06,443 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:06,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:06,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:06,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:06,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,458 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:06,458 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:06,459 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:06,459 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:06,459 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,460 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,461 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,461 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:06,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:06,461 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:06,461 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,463 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,463 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:06,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:06,463 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:06,463 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:06,464 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:06,464 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:06,464 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:06,464 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:06,464 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:06,464 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:06,880 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090720a3561245e3417f9c01c3778a67bbb2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090720a3561245e3417f9c01c3778a67bbb2 2023-03-20 10:54:07,286 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/035217a8b7c54a2c8e0c4872a3316e2a 2023-03-20 10:54:07,292 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/035217a8b7c54a2c8e0c4872a3316e2a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/035217a8b7c54a2c8e0c4872a3316e2a 2023-03-20 10:54:07,300 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/035217a8b7c54a2c8e0c4872a3316e2a, entries=1, sequenceid=37, filesize=4.9 K 2023-03-20 10:54:07,301 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 837ms, sequenceid=37, compaction requested=true 2023-03-20 10:54:07,301 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:07,301 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:07,302 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:07,302 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:07,302 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,302 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:07,302 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:07,303 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,303 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:07,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,304 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:07,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:07,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6934ed[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:07,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:07,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,306 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:07,306 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:07,306 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:07,306 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:07,307 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:07,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:07,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:07,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:07,308 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:07,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:07,310 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:07,310 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:07,310 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:07,310 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,310 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:07,312 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,312 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,312 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:07,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:07,313 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:07,314 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,317 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:07,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:07,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:54:07,317 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,318 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,318 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:07,318 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:07,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:07,418 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:07,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:07,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:07,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:07,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,429 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:07,429 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:07,429 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:54:07,430 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:07,434 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,434 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,435 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,437 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:07,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:07,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:54:07,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,439 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:54:07,439 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:07,440 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:54:07,442 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:07,442 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:07,442 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:07,442 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. started... 2023-03-20 10:54:07,442 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb051e8df6af553f31841872b29bc531 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:07,485 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120412c4c12e4764f78ae8b6893c080bf0d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120412c4c12e4764f78ae8b6893c080bf0d 2023-03-20 10:54:07,503 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/fa97f553558a43c785ee14e7080158c0 2023-03-20 10:54:07,511 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/fa97f553558a43c785ee14e7080158c0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/fa97f553558a43c785ee14e7080158c0 2023-03-20 10:54:07,521 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/fa97f553558a43c785ee14e7080158c0, entries=1, sequenceid=41, filesize=4.9 K 2023-03-20 10:54:07,522 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb051e8df6af553f31841872b29bc531 in 80ms, sequenceid=41, compaction requested=true 2023-03-20 10:54:07,522 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:07,522 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:07,523 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:07,523 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:07,523 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,523 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:54:07,523 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:54:07,524 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:07,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:07,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:07,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:07,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:07,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:07,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:54:07,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31af67b1[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:07,526 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:07,526 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,526 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,527 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:07,527 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:54:07,527 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:07,527 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,527 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:07,528 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,528 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:54:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:07,528 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:07,528 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:54:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:07,530 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:54:07,531 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:07,531 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:07,531 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,531 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:07,532 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,532 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:07,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:07,532 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:07,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:07,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:07,532 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,534 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,536 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:07,536 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:07,536 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:07,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-20 10:54:07,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:07,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:07,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:07,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:07,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:07,537 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:07,537 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:54:07,638 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:07,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:07,643 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-20 10:54:07,645 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:07,646 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:07,647 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310247647 2023-03-20 10:54:07,648 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:07,652 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:54:07,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-20 10:54:07,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:07,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x5ceb3e3c to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:07,678 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7661930f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:07,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:07,738 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010325ff42f1b3964452ad4b38f8737f1c36 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010325ff42f1b3964452ad4b38f8737f1c36 2023-03-20 10:54:07,748 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:07,766 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:54:07,768 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:54:07,798 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:54:07,799 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:54:07,819 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/73d901b563a048898e0a5da3838e07b1 first=Optional[r5] last=Optional[r6] 2023-03-20 10:54:07,820 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/73d901b563a048898e0a5da3838e07b1}] 2023-03-20 10:54:07,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/73d901b563a048898e0a5da3838e07b1 for inclusion in cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:07,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-20 10:54:07,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:07,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:07,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/73d901b563a048898e0a5da3838e07b1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g7j1t7ugnk3laas0crrscudee2lohtugvs0urjgf1hfmgarlmjmodt3nfrindvda/family1/73d901b563a048898e0a5da3838e07b1 2023-03-20 10:54:07,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g7j1t7ugnk3laas0crrscudee2lohtugvs0urjgf1hfmgarlmjmodt3nfrindvda/family1/73d901b563a048898e0a5da3838e07b1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_ 2023-03-20 10:54:07,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g7j1t7ugnk3laas0crrscudee2lohtugvs0urjgf1hfmgarlmjmodt3nfrindvda/family1/73d901b563a048898e0a5da3838e07b1 into cb051e8df6af553f31841872b29bc531/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_ - updating store file list. 2023-03-20 10:54:07,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_ into cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:07,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g7j1t7ugnk3laas0crrscudee2lohtugvs0urjgf1hfmgarlmjmodt3nfrindvda/family1/73d901b563a048898e0a5da3838e07b1 into cb051e8df6af553f31841872b29bc531/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_) 2023-03-20 10:54:07,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g7j1t7ugnk3laas0crrscudee2lohtugvs0urjgf1hfmgarlmjmodt3nfrindvda/family1/73d901b563a048898e0a5da3838e07b1 2023-03-20 10:54:07,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:54:07,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:54:07,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): cb051e8df6af553f31841872b29bc531/family1 is initiating minor compaction 2023-03-20 10:54:07,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@76c643cd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:07,853 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb051e8df6af553f31841872b29bc531/family1 in testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:07,853 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/389c9105a0b9472d95d24eff224af7e1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/cd645e73fc324c578bc69b85a50b626f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ca6765d8a0f145f0974743849a7c708f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/27f6c1ca8d8248eb89cc58005c72cdd6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/4c31add16bce4af9b55ed3cd1c2069e2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/d9234d14a86d43aabe8fff88e78842f6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/139a38ffeaf64c2881d0cde6e73869ad, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/035217a8b7c54a2c8e0c4872a3316e2a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/fa97f553558a43c785ee14e7080158c0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp, totalSize=49.7 K 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 389c9105a0b9472d95d24eff224af7e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting cd645e73fc324c578bc69b85a50b626f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ca6765d8a0f145f0974743849a7c708f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 27f6c1ca8d8248eb89cc58005c72cdd6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 4c31add16bce4af9b55ed3cd1c2069e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting d9234d14a86d43aabe8fff88e78842f6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 139a38ffeaf64c2881d0cde6e73869ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 035217a8b7c54a2c8e0c4872a3316e2a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting fa97f553558a43c785ee14e7080158c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:54:07,854 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ccab7f284b5744599617b285bbae9930_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:54:07,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:07,857 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:07,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101b9727a470f664964af48af87e78c6c62 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101b9727a470f664964af48af87e78c6c62 2023-03-20 10:54:07,862 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010312012a5a3f6a47a1b3a1ad0bd168a01c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010312012a5a3f6a47a1b3a1ad0bd168a01c 2023-03-20 10:54:07,862 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-20 10:54:07,862 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-20 10:54:07,863 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:07,863 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:07,921 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb051e8df6af553f31841872b29bc531#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:08,368 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/f75343578f534444b202222916c6271b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/f75343578f534444b202222916c6271b 2023-03-20 10:54:08,375 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in cb051e8df6af553f31841872b29bc531/family1 of cb051e8df6af553f31841872b29bc531 into f75343578f534444b202222916c6271b(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:08,375 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:08,376 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679309647853; duration=0sec 2023-03-20 10:54:08,376 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:08,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/389c9105a0b9472d95d24eff224af7e1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/cd645e73fc324c578bc69b85a50b626f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ca6765d8a0f145f0974743849a7c708f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/27f6c1ca8d8248eb89cc58005c72cdd6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/4c31add16bce4af9b55ed3cd1c2069e2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/d9234d14a86d43aabe8fff88e78842f6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/139a38ffeaf64c2881d0cde6e73869ad, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/035217a8b7c54a2c8e0c4872a3316e2a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/fa97f553558a43c785ee14e7080158c0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_] to archive 2023-03-20 10:54:08,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:08,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/389c9105a0b9472d95d24eff224af7e1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/389c9105a0b9472d95d24eff224af7e1 2023-03-20 10:54:08,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/cd645e73fc324c578bc69b85a50b626f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/cd645e73fc324c578bc69b85a50b626f 2023-03-20 10:54:08,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ca6765d8a0f145f0974743849a7c708f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ca6765d8a0f145f0974743849a7c708f 2023-03-20 10:54:08,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/27f6c1ca8d8248eb89cc58005c72cdd6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/27f6c1ca8d8248eb89cc58005c72cdd6 2023-03-20 10:54:08,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/4c31add16bce4af9b55ed3cd1c2069e2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/4c31add16bce4af9b55ed3cd1c2069e2 2023-03-20 10:54:08,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/d9234d14a86d43aabe8fff88e78842f6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/d9234d14a86d43aabe8fff88e78842f6 2023-03-20 10:54:08,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/139a38ffeaf64c2881d0cde6e73869ad to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/139a38ffeaf64c2881d0cde6e73869ad 2023-03-20 10:54:08,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/035217a8b7c54a2c8e0c4872a3316e2a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/035217a8b7c54a2c8e0c4872a3316e2a 2023-03-20 10:54:08,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/fa97f553558a43c785ee14e7080158c0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/fa97f553558a43c785ee14e7080158c0 2023-03-20 10:54:08,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/ccab7f284b5744599617b285bbae9930_SeqId_44_ 2023-03-20 10:54:08,742 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312209cf164c454da5989757b46b6ccbd7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312209cf164c454da5989757b46b6ccbd7 2023-03-20 10:54:08,744 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:08,792 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/531caa0add69405ea8d77cfd6e707e7a first=Optional[r1] last=Optional[r4] 2023-03-20 10:54:08,793 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/531caa0add69405ea8d77cfd6e707e7a}] 2023-03-20 10:54:08,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/531caa0add69405ea8d77cfd6e707e7a for inclusion in cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:08,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-20 10:54:08,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:08,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:08,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/531caa0add69405ea8d77cfd6e707e7a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kbbgq2rudnjpj3rk8t86c000v53b93ib5ed549oqrsf9819fb4ck6j1d860egukl/family1/531caa0add69405ea8d77cfd6e707e7a 2023-03-20 10:54:08,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kbbgq2rudnjpj3rk8t86c000v53b93ib5ed549oqrsf9819fb4ck6j1d860egukl/family1/531caa0add69405ea8d77cfd6e707e7a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_ 2023-03-20 10:54:08,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kbbgq2rudnjpj3rk8t86c000v53b93ib5ed549oqrsf9819fb4ck6j1d860egukl/family1/531caa0add69405ea8d77cfd6e707e7a into cb051e8df6af553f31841872b29bc531/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_ - updating store file list. 2023-03-20 10:54:08,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_ into cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:08,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kbbgq2rudnjpj3rk8t86c000v53b93ib5ed549oqrsf9819fb4ck6j1d860egukl/family1/531caa0add69405ea8d77cfd6e707e7a into cb051e8df6af553f31841872b29bc531/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_) 2023-03-20 10:54:08,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kbbgq2rudnjpj3rk8t86c000v53b93ib5ed549oqrsf9819fb4ck6j1d860egukl/family1/531caa0add69405ea8d77cfd6e707e7a 2023-03-20 10:54:08,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:54:08,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:54:08,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): cb051e8df6af553f31841872b29bc531/family1 is initiating minor compaction (all files) 2023-03-20 10:54:08,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@669b1a20; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:08,822 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb051e8df6af553f31841872b29bc531/family1 in testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:54:08,822 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/136b23e8e6d04db89d1693943ce320d1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/f75343578f534444b202222916c6271b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp, totalSize=178.1 K 2023-03-20 10:54:08,823 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 136b23e8e6d04db89d1693943ce320d1, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:54:08,823 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting f75343578f534444b202222916c6271b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:54:08,824 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 9eb7cba686914ca282cf9faef36c218a_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965247712 2023-03-20 10:54:08,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:08,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:08,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120131f49efa1fdc4177bfe2911352560c87 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120131f49efa1fdc4177bfe2911352560c87 2023-03-20 10:54:08,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205afa96db05a094ceb9e66031bdeba6218 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205afa96db05a094ceb9e66031bdeba6218 2023-03-20 10:54:08,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228aa0bed23c46a4ef5b0a4058ac8461d80 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228aa0bed23c46a4ef5b0a4058ac8461d80 2023-03-20 10:54:08,835 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123140dc9d27f1c94c4785fb0e911df483f6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123140dc9d27f1c94c4785fb0e911df483f6 2023-03-20 10:54:08,835 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-20 10:54:08,835 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-20 10:54:08,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:08,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:08,865 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb051e8df6af553f31841872b29bc531#family1#compaction#23 average throughput is 7.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:09,755 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304d4012b4a2664c439e739570e3eba117 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304d4012b4a2664c439e739570e3eba117 2023-03-20 10:54:09,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:09,762 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/.tmp/family1/e649d48dc2c447e1a53b8823acafd935 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/e649d48dc2c447e1a53b8823acafd935 2023-03-20 10:54:09,778 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb051e8df6af553f31841872b29bc531/family1 of cb051e8df6af553f31841872b29bc531 into e649d48dc2c447e1a53b8823acafd935(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:09,779 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:09,779 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1679309648822; duration=0sec 2023-03-20 10:54:09,779 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:09,793 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50cef055f61b47d7a4fa13c4bde7f5c0 first=Optional[r00] last=Optional[r8] 2023-03-20 10:54:09,795 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50cef055f61b47d7a4fa13c4bde7f5c0}] 2023-03-20 10:54:09,798 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50cef055f61b47d7a4fa13c4bde7f5c0 for inclusion in cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:09,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-20 10:54:09,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:09,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:54:09,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50cef055f61b47d7a4fa13c4bde7f5c0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r5pou78umvaufat4r4am30mhcn32uh2hqp7ej4jmc23aafgraefsg0vkc36n5v4a/family1/50cef055f61b47d7a4fa13c4bde7f5c0 2023-03-20 10:54:09,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r5pou78umvaufat4r4am30mhcn32uh2hqp7ej4jmc23aafgraefsg0vkc36n5v4a/family1/50cef055f61b47d7a4fa13c4bde7f5c0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/c4fb063a2f1f4ec9ac3dcf8c6fc75a12_SeqId_50_ 2023-03-20 10:54:09,807 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r5pou78umvaufat4r4am30mhcn32uh2hqp7ej4jmc23aafgraefsg0vkc36n5v4a/family1/50cef055f61b47d7a4fa13c4bde7f5c0 into cb051e8df6af553f31841872b29bc531/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/c4fb063a2f1f4ec9ac3dcf8c6fc75a12_SeqId_50_ - updating store file list. 2023-03-20 10:54:09,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/c4fb063a2f1f4ec9ac3dcf8c6fc75a12_SeqId_50_ into cb051e8df6af553f31841872b29bc531/family1 2023-03-20 10:54:09,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r5pou78umvaufat4r4am30mhcn32uh2hqp7ej4jmc23aafgraefsg0vkc36n5v4a/family1/50cef055f61b47d7a4fa13c4bde7f5c0 into cb051e8df6af553f31841872b29bc531/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/c4fb063a2f1f4ec9ac3dcf8c6fc75a12_SeqId_50_) 2023-03-20 10:54:09,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r5pou78umvaufat4r4am30mhcn32uh2hqp7ej4jmc23aafgraefsg0vkc36n5v4a/family1/50cef055f61b47d7a4fa13c4bde7f5c0 2023-03-20 10:54:09,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:09,818 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:09,820 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120412c4c12e4764f78ae8b6893c080bf0d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120412c4c12e4764f78ae8b6893c080bf0d 2023-03-20 10:54:09,821 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f12e61077c784e9a9fbc0811831d40f4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f12e61077c784e9a9fbc0811831d40f4 2023-03-20 10:54:09,822 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130c5e41320e26e46ae927565727a69b276 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130c5e41320e26e46ae927565727a69b276 2023-03-20 10:54:09,822 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-20 10:54:09,822 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-20 10:54:09,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:09,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:09,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:54:09,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:54:09,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:09,824 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:09,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.1810 sec 2023-03-20 10:54:09,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/136b23e8e6d04db89d1693943ce320d1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/f75343578f534444b202222916c6271b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_] to archive 2023-03-20 10:54:09,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:09,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/136b23e8e6d04db89d1693943ce320d1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/136b23e8e6d04db89d1693943ce320d1 2023-03-20 10:54:09,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/f75343578f534444b202222916c6271b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/f75343578f534444b202222916c6271b 2023-03-20 10:54:09,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/family1/9eb7cba686914ca282cf9faef36c218a_SeqId_47_ 2023-03-20 10:54:09,960 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=258 (was 249) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45108 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x43cd8bc0-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45018 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45144 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x5ceb3e3c-SendThread(127.0.0.1:62837) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45050 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45166 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45178 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x5ceb3e3c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/823502472.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45292 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1204379180_15 at /127.0.0.1:45226 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45240 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1204379180_15 at /127.0.0.1:45150 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45184 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:34420 [Waiting for operation #39] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62837@0x5ceb3e3c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45124 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45156 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45190 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4accea0a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45090 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-761941448_15 at /127.0.0.1:45126 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=612 (was 592) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=758 (was 877), ProcessCount=186 (was 186), AvailableMemoryMB=9250 (was 9544) 2023-03-20 10:54:09,976 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=758, ProcessCount=186, AvailableMemoryMB=9248 2023-03-20 10:54:09,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-20 10:54:09,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:09,982 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:54:09,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-20 10:54:09,983 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:54:09,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-20 10:54:09,985 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:09,985 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293 empty. 2023-03-20 10:54:09,986 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:09,986 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-20 10:54:10,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-20 10:54:10,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-20 10:54:10,395 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-20 10:54:10,396 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a04bc7a14af3f2e7ba8b032f09927293, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-20 10:54:10,804 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:10,804 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing a04bc7a14af3f2e7ba8b032f09927293, disabling compactions & flushes 2023-03-20 10:54:10,804 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:10,804 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:10,804 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. after waiting 0 ms 2023-03-20 10:54:10,805 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:10,805 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:10,805 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:10,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:54:10,809 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679309650808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309650808"}]},"ts":"1679309650808"} 2023-03-20 10:54:10,812 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:54:10,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:54:10,814 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309650813"}]},"ts":"1679309650813"} 2023-03-20 10:54:10,815 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-20 10:54:10,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a04bc7a14af3f2e7ba8b032f09927293, ASSIGN}] 2023-03-20 10:54:10,820 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a04bc7a14af3f2e7ba8b032f09927293, ASSIGN 2023-03-20 10:54:10,821 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a04bc7a14af3f2e7ba8b032f09927293, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:10,972 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a04bc7a14af3f2e7ba8b032f09927293, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:10,972 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679309650972"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309650972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309650972"}]},"ts":"1679309650972"} 2023-03-20 10:54:10,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure a04bc7a14af3f2e7ba8b032f09927293, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:11,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-20 10:54:11,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:11,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a04bc7a14af3f2e7ba8b032f09927293, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:11,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:11,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,136 INFO [StoreOpener-a04bc7a14af3f2e7ba8b032f09927293-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,138 DEBUG [StoreOpener-a04bc7a14af3f2e7ba8b032f09927293-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1 2023-03-20 10:54:11,138 DEBUG [StoreOpener-a04bc7a14af3f2e7ba8b032f09927293-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1 2023-03-20 10:54:11,138 INFO [StoreOpener-a04bc7a14af3f2e7ba8b032f09927293-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a04bc7a14af3f2e7ba8b032f09927293 columnFamilyName family1 2023-03-20 10:54:11,140 INFO [StoreOpener-a04bc7a14af3f2e7ba8b032f09927293-1] regionserver.HStore(310): Store=a04bc7a14af3f2e7ba8b032f09927293/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:11,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:54:11,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:11,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a04bc7a14af3f2e7ba8b032f09927293; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62034794, jitterRate=-0.07560953497886658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:11,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:11,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293., pid=25, masterSystemTime=1679309651126 2023-03-20 10:54:11,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:11,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:11,153 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a04bc7a14af3f2e7ba8b032f09927293, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:11,153 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679309651153"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309651153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309651153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309651153"}]},"ts":"1679309651153"} 2023-03-20 10:54:11,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-20 10:54:11,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure a04bc7a14af3f2e7ba8b032f09927293, server=jenkins-hbase20.apache.org,44189,1679309623230 in 181 msec 2023-03-20 10:54:11,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-20 10:54:11,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a04bc7a14af3f2e7ba8b032f09927293, ASSIGN in 339 msec 2023-03-20 10:54:11,162 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:54:11,162 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309651162"}]},"ts":"1679309651162"} 2023-03-20 10:54:11,164 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-20 10:54:11,166 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:54:11,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1870 sec 2023-03-20 10:54:12,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-20 10:54:12,091 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-20 10:54:12,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:12,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,127 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:12,127 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:12,127 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:12,127 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:12,128 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,128 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,129 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:12,129 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:12,129 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,129 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:12,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:12,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:12,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:12,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:12,130 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:12,130 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:12,131 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:54:12,554 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305b0ba99e6bf445bbb00cea108f8c088d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511305b0ba99e6bf445bbb00cea108f8c088d 2023-03-20 10:54:12,959 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/a873b4dc06694fb2a61f909643c003b2 2023-03-20 10:54:12,968 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/a873b4dc06694fb2a61f909643c003b2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a873b4dc06694fb2a61f909643c003b2 2023-03-20 10:54:12,976 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a873b4dc06694fb2a61f909643c003b2, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-20 10:54:12,977 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 846ms, sequenceid=5, compaction requested=false 2023-03-20 10:54:12,977 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:12,978 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:12,978 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:12,978 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:12,978 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:12,978 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,978 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:12,978 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:12,979 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,979 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:12,980 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:12,980 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30d9eeee[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:12,981 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:12,981 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,982 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,982 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,982 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:12,982 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:12,982 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:12,982 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:12,983 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,983 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:12,983 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:12,983 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:12,985 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:12,985 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:12,985 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:12,985 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,985 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:12,986 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,986 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:12,986 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,987 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:12,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,988 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:12,990 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:12,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:12,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:12,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:12,990 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:12,991 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:12,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:12,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:13,091 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:13,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:13,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:13,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:13,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,100 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:13,100 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:13,100 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:13,100 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:13,103 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,103 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,104 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,105 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:13,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:13,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:13,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:13,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:13,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,107 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:13,107 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:13,107 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:13,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:13,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:13,108 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:13,108 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:13,108 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:54:13,109 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,109 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:13,135 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112863a9afe064e0451abdf33dccd207c0cd to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112863a9afe064e0451abdf33dccd207c0cd 2023-03-20 10:54:13,145 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/80d210b952ff4be39daad97605a5562e 2023-03-20 10:54:13,154 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/80d210b952ff4be39daad97605a5562e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/80d210b952ff4be39daad97605a5562e 2023-03-20 10:54:13,159 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/80d210b952ff4be39daad97605a5562e, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:54:13,160 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 52ms, sequenceid=9, compaction requested=false 2023-03-20 10:54:13,160 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:13,160 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:13,160 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:13,160 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:13,161 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,161 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:13,161 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:13,162 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,162 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:13,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:13,162 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,162 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:13,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:13,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:13,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a3bbbee[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:13,164 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:13,164 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,165 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,165 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:13,165 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:13,165 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,165 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:13,165 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:13,167 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:13,167 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,167 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:13,167 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:13,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:13,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:13,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:13,172 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:13,172 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:13,172 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:13,172 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,172 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:13,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:13,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:13,182 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:13,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,185 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:13,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,194 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:13,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:13,194 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:13,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:13,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:13,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:13,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:13,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:13,195 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:13,195 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:13,295 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:13,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:13,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:13,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:13,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,304 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:13,304 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:13,304 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:13,304 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:13,304 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,304 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,305 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:13,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:13,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:13,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,306 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,307 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:13,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:13,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:13,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:13,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:13,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:13,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:13,307 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:13,307 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:13,307 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:13,728 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201644773ecc10c4f73aa61aa4a990bf3c4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201644773ecc10c4f73aa61aa4a990bf3c4 2023-03-20 10:54:14,135 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/c9662fb100a64dc0881de4be4201960d 2023-03-20 10:54:14,145 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/c9662fb100a64dc0881de4be4201960d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/c9662fb100a64dc0881de4be4201960d 2023-03-20 10:54:14,153 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/c9662fb100a64dc0881de4be4201960d, entries=1, sequenceid=13, filesize=4.9 K 2023-03-20 10:54:14,155 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 848ms, sequenceid=13, compaction requested=true 2023-03-20 10:54:14,156 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:14,156 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:14,156 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:14,156 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:14,156 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,156 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:14,156 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:14,158 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,158 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:14,158 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,158 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:14,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:14,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe03218[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:14,161 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:14,161 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,162 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,162 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:14,162 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:14,162 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,162 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:14,162 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:14,163 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:14,163 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:14,163 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:14,163 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:14,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:14,167 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:14,167 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:14,167 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:14,167 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,167 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:14,169 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,169 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:14,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,169 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:14,170 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:14,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,171 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,175 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:14,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:14,176 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:14,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:14,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:14,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:14,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:14,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,176 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,176 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:14,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:14,177 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:14,177 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:14,177 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,177 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,277 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:14,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:14,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,286 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:14,286 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:14,286 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:14,286 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:14,287 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,287 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,288 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:14,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:14,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:14,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:14,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:14,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:14,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:14,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:14,290 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:14,290 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:14,290 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:14,291 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,292 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:14,292 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:14,742 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:54:14,742 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ceb3e3c to 127.0.0.1:62837 2023-03-20 10:54:14,743 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:54:14,743 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052d4c4820f0a149a3801ab30c730e6b92 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052d4c4820f0a149a3801ab30c730e6b92 2023-03-20 10:54:14,744 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:54:14,744 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ca23dc6 to 127.0.0.1:62837 2023-03-20 10:54:14,744 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:54:14,745 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:54:14,745 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x545e4385 to 127.0.0.1:62837 2023-03-20 10:54:14,745 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:54:15,152 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/145b5bc583064178963103d18b2ddcb8 2023-03-20 10:54:15,163 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/145b5bc583064178963103d18b2ddcb8 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/145b5bc583064178963103d18b2ddcb8 2023-03-20 10:54:15,169 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/145b5bc583064178963103d18b2ddcb8, entries=1, sequenceid=17, filesize=4.9 K 2023-03-20 10:54:15,170 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 880ms, sequenceid=17, compaction requested=true 2023-03-20 10:54:15,170 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:15,170 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:15,170 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:15,170 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:15,170 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,170 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:15,170 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:15,172 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,172 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:15,172 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,172 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53856ba[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:15,173 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:15,173 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,174 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,174 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:15,174 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:15,174 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:15,174 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,174 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:15,175 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:15,175 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,175 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:15,175 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:15,176 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:15,177 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:15,177 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:15,177 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,177 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:15,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,178 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:15,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:15,178 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:15,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,179 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:15,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,180 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,181 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:15,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:15,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:15,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:15,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:15,181 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:15,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:15,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:15,281 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:15,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:15,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:15,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:15,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,288 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:15,288 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:15,288 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:15,288 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:15,289 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,289 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,290 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:15,290 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:15,290 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:15,290 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,291 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,291 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:15,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:15,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:15,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:15,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:15,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:15,291 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:15,291 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:15,291 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:15,707 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122809f26b8c2ced4e25a143a1aa63e7f401 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122809f26b8c2ced4e25a143a1aa63e7f401 2023-03-20 10:54:16,115 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/bcb9c2f0aba344dca3933c471cb9db7c 2023-03-20 10:54:16,120 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/bcb9c2f0aba344dca3933c471cb9db7c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bcb9c2f0aba344dca3933c471cb9db7c 2023-03-20 10:54:16,127 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bcb9c2f0aba344dca3933c471cb9db7c, entries=1, sequenceid=21, filesize=4.9 K 2023-03-20 10:54:16,128 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 837ms, sequenceid=21, compaction requested=true 2023-03-20 10:54:16,128 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:16,128 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:16,128 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:16,128 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:16,129 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,129 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:16,129 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:16,130 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:16,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,130 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:16,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:16,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:16,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ae9766d[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:16,132 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:16,132 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,133 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,133 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:16,133 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:16,133 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,133 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:16,133 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:16,134 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:16,134 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:16,134 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,134 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:16,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:16,137 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:16,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:16,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:16,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,137 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:16,138 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,138 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:16,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,138 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:16,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:16,139 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,140 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,142 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:16,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:16,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:16,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:16,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:16,142 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:16,243 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:16,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:16,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:16,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,254 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:16,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:16,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:16,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:16,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,255 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,257 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,257 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:16,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:16,257 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:16,257 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:16,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:16,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,259 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:16,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:16,260 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:16,260 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:16,260 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:16,260 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:16,260 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:16,260 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:16,260 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:16,260 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:16,662 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:54:16,680 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e2deacbdbbe241aebaec58d9e506dee8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e2deacbdbbe241aebaec58d9e506dee8 2023-03-20 10:54:17,098 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/bde0065d61e24c89b1f377c72e71e0f8 2023-03-20 10:54:17,109 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/bde0065d61e24c89b1f377c72e71e0f8 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bde0065d61e24c89b1f377c72e71e0f8 2023-03-20 10:54:17,116 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bde0065d61e24c89b1f377c72e71e0f8, entries=1, sequenceid=25, filesize=4.9 K 2023-03-20 10:54:17,118 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 858ms, sequenceid=25, compaction requested=true 2023-03-20 10:54:17,118 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:17,118 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:17,118 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:17,118 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:17,118 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,119 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:17,119 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:17,121 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,121 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:17,121 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,121 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:17,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:17,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d0a4615[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:17,124 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:17,124 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,125 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:17,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:17,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:17,126 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,126 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:17,128 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,128 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:17,128 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:17,128 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:17,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:17,131 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:17,131 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:17,131 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:17,131 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,131 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:17,134 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,134 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:17,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,134 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:17,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:17,134 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,135 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,136 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:17,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:17,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:17,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:17,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:17,137 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:17,237 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:17,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:17,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:17,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:17,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,245 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:17,245 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:17,245 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:17,245 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:17,246 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,246 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,247 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:17,247 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:17,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:17,247 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:17,247 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:17,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:17,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:17,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:17,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:17,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:17,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:17,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:17,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:17,251 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:17,251 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:17,251 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:17,667 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101040d64fd0f6a45789e2614cd8c02551d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101040d64fd0f6a45789e2614cd8c02551d 2023-03-20 10:54:18,074 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/ee0d2848a65d4708ae45361b1cca6e93 2023-03-20 10:54:18,080 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/ee0d2848a65d4708ae45361b1cca6e93 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/ee0d2848a65d4708ae45361b1cca6e93 2023-03-20 10:54:18,085 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/ee0d2848a65d4708ae45361b1cca6e93, entries=1, sequenceid=29, filesize=4.9 K 2023-03-20 10:54:18,086 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 835ms, sequenceid=29, compaction requested=true 2023-03-20 10:54:18,086 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:18,086 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:18,086 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:18,086 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:18,086 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,086 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:18,086 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:18,087 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,087 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:18,088 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,088 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:18,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:18,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33b4db5e[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:18,089 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:18,089 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,090 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,090 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:18,090 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:18,090 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,090 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:18,090 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:18,091 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,091 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:18,091 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:18,091 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:18,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:18,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:18,095 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:18,095 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:18,095 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:18,095 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,095 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:18,100 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,100 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:18,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,100 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:18,100 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,101 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,109 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:18,109 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:18,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:18,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:18,109 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:18,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:18,109 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:18,109 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,110 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:18,210 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:18,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:18,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:18,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:18,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,217 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:18,217 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:18,217 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:18,217 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:18,218 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,218 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,219 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:18,219 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:18,219 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,219 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:18,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,220 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,220 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:18,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:18,220 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:18,220 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:18,220 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:18,640 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038c1730777bf1402080949b54392d9802 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038c1730777bf1402080949b54392d9802 2023-03-20 10:54:18,648 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/a016ef3290074fa88c20dfaa7a3fa6f7 2023-03-20 10:54:18,655 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/a016ef3290074fa88c20dfaa7a3fa6f7 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a016ef3290074fa88c20dfaa7a3fa6f7 2023-03-20 10:54:18,662 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a016ef3290074fa88c20dfaa7a3fa6f7, entries=1, sequenceid=33, filesize=4.9 K 2023-03-20 10:54:18,663 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 443ms, sequenceid=33, compaction requested=true 2023-03-20 10:54:18,663 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:18,663 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:18,663 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:18,663 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:18,663 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,663 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:18,663 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:18,664 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,664 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:18,665 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,665 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@747ed614[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:18,666 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:18,666 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,667 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:18,667 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,667 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:18,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:18,667 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:18,668 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,668 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:18,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:18,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:18,668 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:18,668 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:18,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:18,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:18,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:18,670 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:18,670 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:18,670 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:18,670 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,670 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:18,671 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,671 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:18,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,671 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:18,672 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,673 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,674 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,674 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,674 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:18,674 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:18,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:18,674 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:18,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,675 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:18,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:18,775 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:18,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:18,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:18,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:18,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,785 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:18,785 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:18,785 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:18,785 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:18,785 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,785 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,786 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:18,786 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:18,787 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:18,787 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,788 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:18,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:18,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:18,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:18,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:18,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:18,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:18,788 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:18,788 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:18,788 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:19,208 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907df399d89a50d4ebbbeec447aa5e4adb7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907df399d89a50d4ebbbeec447aa5e4adb7 2023-03-20 10:54:19,618 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/a4f76cc94b1744d29ba2293c434d0fec 2023-03-20 10:54:19,630 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/a4f76cc94b1744d29ba2293c434d0fec as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a4f76cc94b1744d29ba2293c434d0fec 2023-03-20 10:54:19,638 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a4f76cc94b1744d29ba2293c434d0fec, entries=1, sequenceid=37, filesize=4.9 K 2023-03-20 10:54:19,639 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 851ms, sequenceid=37, compaction requested=true 2023-03-20 10:54:19,639 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:19,639 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:19,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:19,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:19,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:19,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:19,642 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,642 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:19,643 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,643 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:19,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:19,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:19,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:19,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45959ce8[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:19,645 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:19,645 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,646 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:19,646 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:19,646 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,646 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:19,646 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:19,647 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,647 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:19,647 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:19,648 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:19,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:19,650 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:19,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:19,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:19,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,650 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:19,651 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,651 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:19,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:19,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,651 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:19,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:19,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:19,651 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,652 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:19,654 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:19,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:19,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:19,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:19,654 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,655 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,655 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,655 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:19,655 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:19,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:19,755 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:19,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:19,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:19,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:19,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,768 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:19,768 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:19,768 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:19,768 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:19,769 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,769 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,770 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,770 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:19,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:19,771 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:19,771 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,773 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,774 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:19,774 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:19,774 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:19,774 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:19,774 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:19,774 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:19,774 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:19,775 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. started... 2023-03-20 10:54:19,775 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a04bc7a14af3f2e7ba8b032f09927293 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:20,197 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fd40abf2a34c45518e4b5dcf21c990db to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120fd40abf2a34c45518e4b5dcf21c990db 2023-03-20 10:54:20,605 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/8fed280c60974766a24898a968ce8767 2023-03-20 10:54:20,613 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/8fed280c60974766a24898a968ce8767 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/8fed280c60974766a24898a968ce8767 2023-03-20 10:54:20,619 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/8fed280c60974766a24898a968ce8767, entries=1, sequenceid=41, filesize=4.9 K 2023-03-20 10:54:20,621 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a04bc7a14af3f2e7ba8b032f09927293 in 846ms, sequenceid=41, compaction requested=true 2023-03-20 10:54:20,621 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:20,621 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:20,621 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:20,621 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:20,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:20,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:20,623 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,624 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:20,624 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,624 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:20,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:20,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:20,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:20,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a0050a1[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:20,627 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:20,627 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,628 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,629 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:20,629 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:20,629 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:20,629 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,629 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:20,630 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,630 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:20,630 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:20,630 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:20,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:20,633 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:20,633 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:20,633 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:20,633 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,633 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:20,634 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,634 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:20,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:20,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,634 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:20,635 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:20,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,636 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:20,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-20 10:54:20,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:20,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,638 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:20,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:20,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:20,638 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:20,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:20,639 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,639 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:20,639 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,739 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:20,745 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-20 10:54:20,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:20,750 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:20,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:20,751 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310260751 2023-03-20 10:54:20,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-20 10:54:20,753 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-20 10:54:20,753 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:20,754 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x740e57e3 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:20,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e8d4b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:20,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,603 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030da5b8e13b6841bd9603702ebb9186de to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030da5b8e13b6841bd9603702ebb9186de 2023-03-20 10:54:21,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:21,619 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:54:21,621 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:54:21,628 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:54:21,630 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:54:21,645 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/567876b249414a2999d635047ee5a8e2 first=Optional[r3] last=Optional[r6] 2023-03-20 10:54:21,646 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/567876b249414a2999d635047ee5a8e2}] 2023-03-20 10:54:21,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/567876b249414a2999d635047ee5a8e2 for inclusion in a04bc7a14af3f2e7ba8b032f09927293/family1 2023-03-20 10:54:21,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-20 10:54:21,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:21,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:21,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/567876b249414a2999d635047ee5a8e2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nph8nl421sv6rhaf5e6bem66nanqvqqobj6onvmhkre0rvjkifh1j2cb8ai18vkp/family1/567876b249414a2999d635047ee5a8e2 2023-03-20 10:54:21,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nph8nl421sv6rhaf5e6bem66nanqvqqobj6onvmhkre0rvjkifh1j2cb8ai18vkp/family1/567876b249414a2999d635047ee5a8e2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_ 2023-03-20 10:54:21,658 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nph8nl421sv6rhaf5e6bem66nanqvqqobj6onvmhkre0rvjkifh1j2cb8ai18vkp/family1/567876b249414a2999d635047ee5a8e2 into a04bc7a14af3f2e7ba8b032f09927293/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_ - updating store file list. 2023-03-20 10:54:21,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_ into a04bc7a14af3f2e7ba8b032f09927293/family1 2023-03-20 10:54:21,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nph8nl421sv6rhaf5e6bem66nanqvqqobj6onvmhkre0rvjkifh1j2cb8ai18vkp/family1/567876b249414a2999d635047ee5a8e2 into a04bc7a14af3f2e7ba8b032f09927293/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_) 2023-03-20 10:54:21,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nph8nl421sv6rhaf5e6bem66nanqvqqobj6onvmhkre0rvjkifh1j2cb8ai18vkp/family1/567876b249414a2999d635047ee5a8e2 2023-03-20 10:54:21,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:54:21,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:54:21,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): a04bc7a14af3f2e7ba8b032f09927293/family1 is initiating minor compaction 2023-03-20 10:54:21,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@b0f1712; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:21,669 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a04bc7a14af3f2e7ba8b032f09927293/family1 in testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:21,669 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/80d210b952ff4be39daad97605a5562e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/c9662fb100a64dc0881de4be4201960d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/145b5bc583064178963103d18b2ddcb8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bcb9c2f0aba344dca3933c471cb9db7c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bde0065d61e24c89b1f377c72e71e0f8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/ee0d2848a65d4708ae45361b1cca6e93, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a016ef3290074fa88c20dfaa7a3fa6f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a4f76cc94b1744d29ba2293c434d0fec, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/8fed280c60974766a24898a968ce8767, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp, totalSize=50.0 K 2023-03-20 10:54:21,669 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 80d210b952ff4be39daad97605a5562e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:54:21,669 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting c9662fb100a64dc0881de4be4201960d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:54:21,669 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 145b5bc583064178963103d18b2ddcb8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting bcb9c2f0aba344dca3933c471cb9db7c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting bde0065d61e24c89b1f377c72e71e0f8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ee0d2848a65d4708ae45361b1cca6e93, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting a016ef3290074fa88c20dfaa7a3fa6f7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting a4f76cc94b1744d29ba2293c434d0fec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 8fed280c60974766a24898a968ce8767, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:54:21,670 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 6209406e2bab479b953a04f56fa5b135_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:54:21,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:21,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:21,684 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122809f26b8c2ced4e25a143a1aa63e7f401 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122809f26b8c2ced4e25a143a1aa63e7f401 2023-03-20 10:54:21,690 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e2deacbdbbe241aebaec58d9e506dee8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e2deacbdbbe241aebaec58d9e506dee8 2023-03-20 10:54:21,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101040d64fd0f6a45789e2614cd8c02551d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101040d64fd0f6a45789e2614cd8c02551d 2023-03-20 10:54:21,693 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038c1730777bf1402080949b54392d9802 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038c1730777bf1402080949b54392d9802 2023-03-20 10:54:21,693 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-20 10:54:21,693 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:21,747 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): a04bc7a14af3f2e7ba8b032f09927293#family1#compaction#34 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:22,157 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056e5637bbcd3c4ad09194650f4630c9df to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056e5637bbcd3c4ad09194650f4630c9df 2023-03-20 10:54:22,159 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:22,175 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/527456c82abf491f924bc363d0b96fc9 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/527456c82abf491f924bc363d0b96fc9 2023-03-20 10:54:22,187 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a04bc7a14af3f2e7ba8b032f09927293/family1 of a04bc7a14af3f2e7ba8b032f09927293 into 527456c82abf491f924bc363d0b96fc9(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:22,187 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:22,187 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679309661669; duration=0sec 2023-03-20 10:54:22,188 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:22,202 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f77658dfb2c4374be69609f0ca54183 first=Optional[r1] last=Optional[r2] 2023-03-20 10:54:22,203 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f77658dfb2c4374be69609f0ca54183}] 2023-03-20 10:54:22,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f77658dfb2c4374be69609f0ca54183 for inclusion in a04bc7a14af3f2e7ba8b032f09927293/family1 2023-03-20 10:54:22,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-20 10:54:22,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:22,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:22,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f77658dfb2c4374be69609f0ca54183 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__845oo3o1thkdtu2i756btggbphfl7gag60sa9df4cvckbes1jt2el3b26gmuu8hl/family1/1f77658dfb2c4374be69609f0ca54183 2023-03-20 10:54:22,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__845oo3o1thkdtu2i756btggbphfl7gag60sa9df4cvckbes1jt2el3b26gmuu8hl/family1/1f77658dfb2c4374be69609f0ca54183 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_ 2023-03-20 10:54:22,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__845oo3o1thkdtu2i756btggbphfl7gag60sa9df4cvckbes1jt2el3b26gmuu8hl/family1/1f77658dfb2c4374be69609f0ca54183 into a04bc7a14af3f2e7ba8b032f09927293/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_ - updating store file list. 2023-03-20 10:54:22,221 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_ into a04bc7a14af3f2e7ba8b032f09927293/family1 2023-03-20 10:54:22,221 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__845oo3o1thkdtu2i756btggbphfl7gag60sa9df4cvckbes1jt2el3b26gmuu8hl/family1/1f77658dfb2c4374be69609f0ca54183 into a04bc7a14af3f2e7ba8b032f09927293/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_) 2023-03-20 10:54:22,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithWeeklyPolicy__845oo3o1thkdtu2i756btggbphfl7gag60sa9df4cvckbes1jt2el3b26gmuu8hl/family1/1f77658dfb2c4374be69609f0ca54183 2023-03-20 10:54:22,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:54:22,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:54:22,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): a04bc7a14af3f2e7ba8b032f09927293/family1 is initiating minor compaction (all files) 2023-03-20 10:54:22,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@66fc63cb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:22,223 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a04bc7a14af3f2e7ba8b032f09927293/family1 in testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:54:22,223 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a873b4dc06694fb2a61f909643c003b2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/527456c82abf491f924bc363d0b96fc9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp, totalSize=176.8 K 2023-03-20 10:54:22,224 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting a873b4dc06694fb2a61f909643c003b2, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:54:22,224 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 527456c82abf491f924bc363d0b96fc9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:54:22,225 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 86b8a203ccb54f88ba4af374178759d3_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965247712 2023-03-20 10:54:22,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:22,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:22,231 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201644773ecc10c4f73aa61aa4a990bf3c4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201644773ecc10c4f73aa61aa4a990bf3c4 2023-03-20 10:54:22,233 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052d4c4820f0a149a3801ab30c730e6b92 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052d4c4820f0a149a3801ab30c730e6b92 2023-03-20 10:54:22,233 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-20 10:54:22,233 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-20 10:54:22,234 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:22,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:22,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:22,235 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:22,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4880 sec 2023-03-20 10:54:22,253 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): a04bc7a14af3f2e7ba8b032f09927293#family1#compaction#35 average throughput is 10.31 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:22,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/80d210b952ff4be39daad97605a5562e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/c9662fb100a64dc0881de4be4201960d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/145b5bc583064178963103d18b2ddcb8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bcb9c2f0aba344dca3933c471cb9db7c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bde0065d61e24c89b1f377c72e71e0f8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/ee0d2848a65d4708ae45361b1cca6e93, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a016ef3290074fa88c20dfaa7a3fa6f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a4f76cc94b1744d29ba2293c434d0fec, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/8fed280c60974766a24898a968ce8767, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_] to archive 2023-03-20 10:54:22,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:22,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/80d210b952ff4be39daad97605a5562e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/80d210b952ff4be39daad97605a5562e 2023-03-20 10:54:22,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/c9662fb100a64dc0881de4be4201960d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/c9662fb100a64dc0881de4be4201960d 2023-03-20 10:54:22,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/145b5bc583064178963103d18b2ddcb8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/145b5bc583064178963103d18b2ddcb8 2023-03-20 10:54:22,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bcb9c2f0aba344dca3933c471cb9db7c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bcb9c2f0aba344dca3933c471cb9db7c 2023-03-20 10:54:22,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bde0065d61e24c89b1f377c72e71e0f8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/bde0065d61e24c89b1f377c72e71e0f8 2023-03-20 10:54:22,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/ee0d2848a65d4708ae45361b1cca6e93 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/ee0d2848a65d4708ae45361b1cca6e93 2023-03-20 10:54:22,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a016ef3290074fa88c20dfaa7a3fa6f7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a016ef3290074fa88c20dfaa7a3fa6f7 2023-03-20 10:54:22,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a4f76cc94b1744d29ba2293c434d0fec to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a4f76cc94b1744d29ba2293c434d0fec 2023-03-20 10:54:22,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/8fed280c60974766a24898a968ce8767 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/8fed280c60974766a24898a968ce8767 2023-03-20 10:54:22,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/6209406e2bab479b953a04f56fa5b135_SeqId_44_ 2023-03-20 10:54:22,352 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255 (was 258), OpenFileDescriptor=599 (was 612), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=590 (was 758), ProcessCount=187 (was 186) - ProcessCount LEAK? -, AvailableMemoryMB=9155 (was 9248) 2023-03-20 10:54:22,362 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=255, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=590, ProcessCount=187, AvailableMemoryMB=9154 2023-03-20 10:54:22,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-20 10:54:22,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:22,367 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:54:22,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-20 10:54:22,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:54:22,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-20 10:54:22,370 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:22,370 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:22,370 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:22,371 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946 empty. 2023-03-20 10:54:22,371 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27 empty. 2023-03-20 10:54:22,371 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e empty. 2023-03-20 10:54:22,371 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:22,371 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:22,371 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:22,371 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-20 10:54:22,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-20 10:54:22,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-20 10:54:22,779 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-20 10:54:22,780 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 00d90e2015616273fc20d11ce70eed5e, NAME => 'testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:22,780 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2d9e3cf84600d62e9e4feea6fe7edd27, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:22,780 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 13d22083541370fcb2ebc25e6603a946, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:22,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-20 10:54:23,193 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:23,194 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 13d22083541370fcb2ebc25e6603a946, disabling compactions & flushes 2023-03-20 10:54:23,194 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,194 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,194 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. after waiting 0 ms 2023-03-20 10:54:23,194 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,194 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,194 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 13d22083541370fcb2ebc25e6603a946: 2023-03-20 10:54:23,194 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:23,195 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 2d9e3cf84600d62e9e4feea6fe7edd27, disabling compactions & flushes 2023-03-20 10:54:23,195 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,195 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,195 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. after waiting 0 ms 2023-03-20 10:54:23,195 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,195 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,195 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:54:23,197 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:23,197 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 00d90e2015616273fc20d11ce70eed5e, disabling compactions & flushes 2023-03-20 10:54:23,197 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,197 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,197 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. after waiting 0 ms 2023-03-20 10:54:23,197 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,197 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,197 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 00d90e2015616273fc20d11ce70eed5e: 2023-03-20 10:54:23,200 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:54:23,201 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679309663201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309663201"}]},"ts":"1679309663201"} 2023-03-20 10:54:23,202 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679309663201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309663201"}]},"ts":"1679309663201"} 2023-03-20 10:54:23,202 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679309663201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309663201"}]},"ts":"1679309663201"} 2023-03-20 10:54:23,205 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-20 10:54:23,206 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:54:23,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309663206"}]},"ts":"1679309663206"} 2023-03-20 10:54:23,208 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-20 10:54:23,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00d90e2015616273fc20d11ce70eed5e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13d22083541370fcb2ebc25e6603a946, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2d9e3cf84600d62e9e4feea6fe7edd27, ASSIGN}] 2023-03-20 10:54:23,213 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00d90e2015616273fc20d11ce70eed5e, ASSIGN 2023-03-20 10:54:23,213 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13d22083541370fcb2ebc25e6603a946, ASSIGN 2023-03-20 10:54:23,213 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2d9e3cf84600d62e9e4feea6fe7edd27, ASSIGN 2023-03-20 10:54:23,215 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00d90e2015616273fc20d11ce70eed5e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:23,215 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2d9e3cf84600d62e9e4feea6fe7edd27, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:23,215 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13d22083541370fcb2ebc25e6603a946, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:23,367 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2d9e3cf84600d62e9e4feea6fe7edd27, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:23,367 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=13d22083541370fcb2ebc25e6603a946, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:23,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=00d90e2015616273fc20d11ce70eed5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:23,367 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679309663367"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309663367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309663367"}]},"ts":"1679309663367"} 2023-03-20 10:54:23,367 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679309663367"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309663367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309663367"}]},"ts":"1679309663367"} 2023-03-20 10:54:23,368 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679309663367"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309663367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309663367"}]},"ts":"1679309663367"} 2023-03-20 10:54:23,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 2d9e3cf84600d62e9e4feea6fe7edd27, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:23,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 13d22083541370fcb2ebc25e6603a946, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:23,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 00d90e2015616273fc20d11ce70eed5e, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:23,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-20 10:54:23,487 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/.tmp/family1/1df92a1d050d47e6a38c3bdd50b9a7dd as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/1df92a1d050d47e6a38c3bdd50b9a7dd 2023-03-20 10:54:23,496 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a04bc7a14af3f2e7ba8b032f09927293/family1 of a04bc7a14af3f2e7ba8b032f09927293 into 1df92a1d050d47e6a38c3bdd50b9a7dd(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:54:23,496 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:54:23,496 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1679309662223; duration=1sec 2023-03-20 10:54:23,496 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:23,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13d22083541370fcb2ebc25e6603a946, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.', STARTKEY => '1', ENDKEY => '2'} 2023-03-20 10:54:23,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:23,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,526 INFO [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,528 DEBUG [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946/family1 2023-03-20 10:54:23,528 DEBUG [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946/family1 2023-03-20 10:54:23,529 INFO [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13d22083541370fcb2ebc25e6603a946 columnFamilyName family1 2023-03-20 10:54:23,531 INFO [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] regionserver.HStore(310): Store=13d22083541370fcb2ebc25e6603a946/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:23,531 INFO [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,533 DEBUG [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946/family2 2023-03-20 10:54:23,533 DEBUG [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946/family2 2023-03-20 10:54:23,533 INFO [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13d22083541370fcb2ebc25e6603a946 columnFamilyName family2 2023-03-20 10:54:23,535 INFO [StoreOpener-13d22083541370fcb2ebc25e6603a946-1] regionserver.HStore(310): Store=13d22083541370fcb2ebc25e6603a946/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:23,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:54:23,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:54:23,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:23,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 13d22083541370fcb2ebc25e6603a946; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69318432, jitterRate=0.03292512893676758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:54:23,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 13d22083541370fcb2ebc25e6603a946: 2023-03-20 10:54:23,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946., pid=32, masterSystemTime=1679309663521 2023-03-20 10:54:23,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:23,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 00d90e2015616273fc20d11ce70eed5e, NAME => 'testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.', STARTKEY => '', ENDKEY => '1'} 2023-03-20 10:54:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:23,551 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=13d22083541370fcb2ebc25e6603a946, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,552 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679309663551"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309663551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309663551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309663551"}]},"ts":"1679309663551"} 2023-03-20 10:54:23,553 INFO [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,555 DEBUG [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e/family1 2023-03-20 10:54:23,555 DEBUG [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e/family1 2023-03-20 10:54:23,555 INFO [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00d90e2015616273fc20d11ce70eed5e columnFamilyName family1 2023-03-20 10:54:23,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-03-20 10:54:23,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 13d22083541370fcb2ebc25e6603a946, server=jenkins-hbase20.apache.org,44189,1679309623230 in 184 msec 2023-03-20 10:54:23,557 INFO [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] regionserver.HStore(310): Store=00d90e2015616273fc20d11ce70eed5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:23,557 INFO [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13d22083541370fcb2ebc25e6603a946, ASSIGN in 347 msec 2023-03-20 10:54:23,559 DEBUG [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e/family2 2023-03-20 10:54:23,559 DEBUG [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e/family2 2023-03-20 10:54:23,560 INFO [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00d90e2015616273fc20d11ce70eed5e columnFamilyName family2 2023-03-20 10:54:23,561 INFO [StoreOpener-00d90e2015616273fc20d11ce70eed5e-1] regionserver.HStore(310): Store=00d90e2015616273fc20d11ce70eed5e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:23,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:54:23,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:54:23,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:23,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 00d90e2015616273fc20d11ce70eed5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60594868, jitterRate=-0.09706610441207886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:54:23,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 00d90e2015616273fc20d11ce70eed5e: 2023-03-20 10:54:23,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e., pid=33, masterSystemTime=1679309663521 2023-03-20 10:54:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:23,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d9e3cf84600d62e9e4feea6fe7edd27, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.', STARTKEY => '2', ENDKEY => ''} 2023-03-20 10:54:23,571 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=00d90e2015616273fc20d11ce70eed5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:23,571 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679309663571"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309663571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309663571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309663571"}]},"ts":"1679309663571"} 2023-03-20 10:54:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a873b4dc06694fb2a61f909643c003b2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/527456c82abf491f924bc363d0b96fc9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_] to archive 2023-03-20 10:54:23,577 INFO [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:23,579 DEBUG [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1 2023-03-20 10:54:23,579 DEBUG [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1 2023-03-20 10:54:23,579 INFO [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d9e3cf84600d62e9e4feea6fe7edd27 columnFamilyName family1 2023-03-20 10:54:23,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-03-20 10:54:23,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a873b4dc06694fb2a61f909643c003b2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/a873b4dc06694fb2a61f909643c003b2 2023-03-20 10:54:23,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 00d90e2015616273fc20d11ce70eed5e, server=jenkins-hbase20.apache.org,44189,1679309623230 in 207 msec 2023-03-20 10:54:23,581 INFO [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] regionserver.HStore(310): Store=2d9e3cf84600d62e9e4feea6fe7edd27/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:23,582 INFO [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/527456c82abf491f924bc363d0b96fc9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/527456c82abf491f924bc363d0b96fc9 2023-03-20 10:54:23,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00d90e2015616273fc20d11ce70eed5e, ASSIGN in 370 msec 2023-03-20 10:54:23,584 DEBUG [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family2 2023-03-20 10:54:23,584 DEBUG [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family2 2023-03-20 10:54:23,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/family1/86b8a203ccb54f88ba4af374178759d3_SeqId_47_ 2023-03-20 10:54:23,585 INFO [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d9e3cf84600d62e9e4feea6fe7edd27 columnFamilyName family2 2023-03-20 10:54:23,586 INFO [StoreOpener-2d9e3cf84600d62e9e4feea6fe7edd27-1] regionserver.HStore(310): Store=2d9e3cf84600d62e9e4feea6fe7edd27/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:23,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:54:23,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:54:23,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:23,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2d9e3cf84600d62e9e4feea6fe7edd27; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61755751, jitterRate=-0.07976759970188141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:54:23,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:54:23,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27., pid=31, masterSystemTime=1679309663521 2023-03-20 10:54:23,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:23,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2d9e3cf84600d62e9e4feea6fe7edd27, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:23,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679309663595"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309663595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309663595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309663595"}]},"ts":"1679309663595"} 2023-03-20 10:54:23,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-03-20 10:54:23,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 2d9e3cf84600d62e9e4feea6fe7edd27, server=jenkins-hbase20.apache.org,44189,1679309623230 in 228 msec 2023-03-20 10:54:23,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=27 2023-03-20 10:54:23,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2d9e3cf84600d62e9e4feea6fe7edd27, ASSIGN in 389 msec 2023-03-20 10:54:23,602 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:54:23,602 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309663602"}]},"ts":"1679309663602"} 2023-03-20 10:54:23,604 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-20 10:54:23,606 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:54:23,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2420 sec 2023-03-20 10:54:24,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-20 10:54:24,477 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-20 10:54:24,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:24,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,495 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-20 10:54:24,495 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:24,495 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-20 10:54:24,495 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-20 10:54:24,495 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,495 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,496 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:24,496 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:24,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:24,496 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:24,496 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:24,498 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-20 10:54:24,498 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:24,498 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-20 10:54:24,498 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:24,498 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:24,498 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. started... 2023-03-20 10:54:24,498 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. started... 2023-03-20 10:54:24,499 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:54:24,500 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 00d90e2015616273fc20d11ce70eed5e: 2023-03-20 10:54:24,500 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:24,500 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 13d22083541370fcb2ebc25e6603a946: 2023-03-20 10:54:24,500 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:24,500 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:24,500 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. started... 2023-03-20 10:54:24,500 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:54:24,500 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:24,501 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2d9e3cf84600d62e9e4feea6fe7edd27 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-20 10:54:24,501 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:54:24,936 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032079f2a36e6cbb4c7ab8bc8ee16ca6b3a4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023032079f2a36e6cbb4c7ab8bc8ee16ca6b3a4 2023-03-20 10:54:25,344 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/.tmp/family1/b204cfa423934c6e845074997d3ae68f 2023-03-20 10:54:25,352 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/.tmp/family1/b204cfa423934c6e845074997d3ae68f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/b204cfa423934c6e845074997d3ae68f 2023-03-20 10:54:25,357 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/b204cfa423934c6e845074997d3ae68f, entries=1, sequenceid=5, filesize=4.9 K 2023-03-20 10:54:25,358 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2d9e3cf84600d62e9e4feea6fe7edd27 in 857ms, sequenceid=5, compaction requested=false 2023-03-20 10:54:25,358 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-20 10:54:25,359 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:54:25,359 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:25,359 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:54:25,359 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:54:25,359 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,359 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-20 10:54:25,359 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-20 10:54:25,360 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:25,360 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:25,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-20 10:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ffb1894[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:25,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-20 10:54:25,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,363 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,363 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-20 10:54:25,363 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-20 10:54:25,363 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:25,364 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,364 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:25,364 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,364 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-20 10:54:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:25,365 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:25,365 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-20 10:54:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:25,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-20 10:54:25,367 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-20 10:54:25,367 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:25,367 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:25,367 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,367 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:25,368 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,368 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:25,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,368 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:25,369 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,370 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:25,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,373 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:25,373 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:25,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:25,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:25,374 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:25,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-20 10:54:25,373 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-20 10:54:25,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:25,374 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:25,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:25,475 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:25,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:25,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:25,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:25,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,482 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-20 10:54:25,482 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:25,482 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-20 10:54:25,482 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-20 10:54:25,483 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,483 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,484 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:25,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:25,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:25,484 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,485 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,485 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-20 10:54:25,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-20 10:54:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. started... 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 13d22083541370fcb2ebc25e6603a946: 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. started... 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. started... 2023-03-20 10:54:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:25,486 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2d9e3cf84600d62e9e4feea6fe7edd27 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 00d90e2015616273fc20d11ce70eed5e: 2023-03-20 10:54:25,486 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:54:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:54:25,487 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:54:25,904 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320f2ae70737053415ba9d7874f890b4c1a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230320f2ae70737053415ba9d7874f890b4c1a 2023-03-20 10:54:26,315 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/.tmp/family1/1b34967a510e401d940f7e79ea4b7649 2023-03-20 10:54:26,327 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/.tmp/family1/1b34967a510e401d940f7e79ea4b7649 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/1b34967a510e401d940f7e79ea4b7649 2023-03-20 10:54:26,332 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/1b34967a510e401d940f7e79ea4b7649, entries=2, sequenceid=9, filesize=5.0 K 2023-03-20 10:54:26,333 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2d9e3cf84600d62e9e4feea6fe7edd27 in 847ms, sequenceid=9, compaction requested=false 2023-03-20 10:54:26,334 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:54:26,334 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:26,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:54:26,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:54:26,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-20 10:54:26,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-20 10:54:26,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,335 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:26,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:26,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-20 10:54:26,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db7bf09[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:26,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-20 10:54:26,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,339 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-20 10:54:26,339 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-20 10:54:26,339 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:26,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:26,340 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-20 10:54:26,340 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:26,340 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-20 10:54:26,340 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-20 10:54:26,344 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-20 10:54:26,344 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:26,344 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:26,344 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,344 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:26,345 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,345 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,346 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:26,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:26,346 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,348 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:26,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-20 10:54:26,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,350 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:26,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:26,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,350 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:26,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,451 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:26,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:26,469 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-20 10:54:26,471 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-20 10:54:26,472 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-20 10:54:26,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:26,473 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310266473 2023-03-20 10:54:26,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:54:26,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-20 10:54:26,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-20 10:54:26,474 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x588ef04d to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:26,478 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c3b41a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:26,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230320 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-20 10:54:27,310 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320cacffd2410304b98ac5b547e51009b52 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230320cacffd2410304b98ac5b547e51009b52 2023-03-20 10:54:27,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-20 10:54:27,328 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:54:27,329 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:54:27,336 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:54:27,338 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:54:27,348 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230320/family1/1e2844ab42e54db89b6b9dbae1ccb545 first=Optional[k0] last=Optional[k1] 2023-03-20 10:54:27,349 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230320/family1/1e2844ab42e54db89b6b9dbae1ccb545}] 2023-03-20 10:54:27,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230320/family1/1e2844ab42e54db89b6b9dbae1ccb545 for inclusion in 2d9e3cf84600d62e9e4feea6fe7edd27/family1 2023-03-20 10:54:27,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-20 10:54:27,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-20 10:54:27,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:54:27,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230320/family1/1e2844ab42e54db89b6b9dbae1ccb545 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testScannerOnBulkLoadRefHFiles__vlhtko6aciuv7i9i332h8i60sl368o2rdg24jgu8fmbas9908vu2dr9q7vroka7s/family1/1e2844ab42e54db89b6b9dbae1ccb545 2023-03-20 10:54:27,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testScannerOnBulkLoadRefHFiles__vlhtko6aciuv7i9i332h8i60sl368o2rdg24jgu8fmbas9908vu2dr9q7vroka7s/family1/1e2844ab42e54db89b6b9dbae1ccb545 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_ 2023-03-20 10:54:27,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testScannerOnBulkLoadRefHFiles__vlhtko6aciuv7i9i332h8i60sl368o2rdg24jgu8fmbas9908vu2dr9q7vroka7s/family1/1e2844ab42e54db89b6b9dbae1ccb545 into 2d9e3cf84600d62e9e4feea6fe7edd27/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_ - updating store file list. 2023-03-20 10:54:27,370 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_ into 2d9e3cf84600d62e9e4feea6fe7edd27/family1 2023-03-20 10:54:27,370 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testScannerOnBulkLoadRefHFiles__vlhtko6aciuv7i9i332h8i60sl368o2rdg24jgu8fmbas9908vu2dr9q7vroka7s/family1/1e2844ab42e54db89b6b9dbae1ccb545 into 2d9e3cf84600d62e9e4feea6fe7edd27/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_) 2023-03-20 10:54:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testScannerOnBulkLoadRefHFiles__vlhtko6aciuv7i9i332h8i60sl368o2rdg24jgu8fmbas9908vu2dr9q7vroka7s/family1/1e2844ab42e54db89b6b9dbae1ccb545 2023-03-20 10:54:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:54:27,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:54:27,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): 2d9e3cf84600d62e9e4feea6fe7edd27/family1 is initiating minor compaction (all files) 2023-03-20 10:54:27,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@57c0849b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:27,373 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2d9e3cf84600d62e9e4feea6fe7edd27/family1 in testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:54:27,373 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/b204cfa423934c6e845074997d3ae68f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/1b34967a510e401d940f7e79ea4b7649, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/.tmp, totalSize=15.1 K 2023-03-20 10:54:27,374 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting b204cfa423934c6e845074997d3ae68f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309664478 2023-03-20 10:54:27,375 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 1b34967a510e401d940f7e79ea4b7649, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309664478 2023-03-20 10:54:27,375 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 82a0d519f7314cca8bb356a8990ad799_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309664478 2023-03-20 10:54:27,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-20 10:54:27,377 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:27,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023032079f2a36e6cbb4c7ab8bc8ee16ca6b3a4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023032079f2a36e6cbb4c7ab8bc8ee16ca6b3a4 2023-03-20 10:54:27,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230320f2ae70737053415ba9d7874f890b4c1a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230320f2ae70737053415ba9d7874f890b4c1a 2023-03-20 10:54:27,381 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-20 10:54:27,381 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230320' 2023-03-20 10:54:27,382 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230320 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-20 10:54:27,382 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-20 10:54:27,382 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:27,383 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-20 10:54:27,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 913 msec 2023-03-20 10:54:27,388 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2d9e3cf84600d62e9e4feea6fe7edd27#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:27,416 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=254 (was 255), OpenFileDescriptor=601 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=543 (was 590), ProcessCount=187 (was 187), AvailableMemoryMB=9154 (was 9154) 2023-03-20 10:54:27,428 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=254, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=543, ProcessCount=187, AvailableMemoryMB=9153 2023-03-20 10:54:27,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-20 10:54:27,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:27,433 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:54:27,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-20 10:54:27,434 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:54:27,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-20 10:54:27,435 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:27,435 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65 empty. 2023-03-20 10:54:27,436 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:27,436 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-20 10:54:27,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-20 10:54:27,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-20 10:54:27,847 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-20 10:54:27,848 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d04a13b1886cbfc7a73fc35394f94d65, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:28,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-20 10:54:28,212 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/.tmp/family1/749a78eb79524e55be108d75a7306421 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/749a78eb79524e55be108d75a7306421 2023-03-20 10:54:28,219 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2d9e3cf84600d62e9e4feea6fe7edd27/family1 of 2d9e3cf84600d62e9e4feea6fe7edd27 into 749a78eb79524e55be108d75a7306421(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:28,219 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:54:28,219 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1679309667373; duration=0sec 2023-03-20 10:54:28,219 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:28,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:28,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing d04a13b1886cbfc7a73fc35394f94d65, disabling compactions & flushes 2023-03-20 10:54:28,260 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,261 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,261 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. after waiting 0 ms 2023-03-20 10:54:28,261 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,261 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,261 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:28,263 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:54:28,264 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679309668264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309668264"}]},"ts":"1679309668264"} 2023-03-20 10:54:28,266 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:54:28,267 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:54:28,267 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309668267"}]},"ts":"1679309668267"} 2023-03-20 10:54:28,268 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-20 10:54:28,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d04a13b1886cbfc7a73fc35394f94d65, ASSIGN}] 2023-03-20 10:54:28,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d04a13b1886cbfc7a73fc35394f94d65, ASSIGN 2023-03-20 10:54:28,273 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d04a13b1886cbfc7a73fc35394f94d65, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:28,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/b204cfa423934c6e845074997d3ae68f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/1b34967a510e401d940f7e79ea4b7649, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_] to archive 2023-03-20 10:54:28,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:28,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/b204cfa423934c6e845074997d3ae68f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/b204cfa423934c6e845074997d3ae68f 2023-03-20 10:54:28,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/1b34967a510e401d940f7e79ea4b7649 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/1b34967a510e401d940f7e79ea4b7649 2023-03-20 10:54:28,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/family1/82a0d519f7314cca8bb356a8990ad799_SeqId_12_ 2023-03-20 10:54:28,424 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d04a13b1886cbfc7a73fc35394f94d65, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:28,425 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679309668424"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309668424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309668424"}]},"ts":"1679309668424"} 2023-03-20 10:54:28,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure d04a13b1886cbfc7a73fc35394f94d65, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:28,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-20 10:54:28,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d04a13b1886cbfc7a73fc35394f94d65, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:28,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:28,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,586 INFO [StoreOpener-d04a13b1886cbfc7a73fc35394f94d65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,587 DEBUG [StoreOpener-d04a13b1886cbfc7a73fc35394f94d65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1 2023-03-20 10:54:28,587 DEBUG [StoreOpener-d04a13b1886cbfc7a73fc35394f94d65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1 2023-03-20 10:54:28,588 INFO [StoreOpener-d04a13b1886cbfc7a73fc35394f94d65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d04a13b1886cbfc7a73fc35394f94d65 columnFamilyName family1 2023-03-20 10:54:28,589 INFO [StoreOpener-d04a13b1886cbfc7a73fc35394f94d65-1] regionserver.HStore(310): Store=d04a13b1886cbfc7a73fc35394f94d65/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:28,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:54:28,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:28,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d04a13b1886cbfc7a73fc35394f94d65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69371158, jitterRate=0.03371080756187439}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:28,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:28,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65., pid=37, masterSystemTime=1679309668580 2023-03-20 10:54:28,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:28,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d04a13b1886cbfc7a73fc35394f94d65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:28,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679309668600"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309668600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309668600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309668600"}]},"ts":"1679309668600"} 2023-03-20 10:54:28,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-20 10:54:28,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure d04a13b1886cbfc7a73fc35394f94d65, server=jenkins-hbase20.apache.org,44189,1679309623230 in 174 msec 2023-03-20 10:54:28,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-20 10:54:28,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d04a13b1886cbfc7a73fc35394f94d65, ASSIGN in 334 msec 2023-03-20 10:54:28,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:54:28,607 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309668607"}]},"ts":"1679309668607"} 2023-03-20 10:54:28,608 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-20 10:54:28,611 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:54:28,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1810 sec 2023-03-20 10:54:29,070 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:54:29,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-20 10:54:29,542 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-20 10:54:29,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:29,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,577 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:29,577 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:29,577 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:29,577 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:29,577 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,577 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,578 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:29,578 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:29,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:29,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:29,578 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:29,578 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:29,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:29,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:29,579 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:29,580 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:29,580 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:29,580 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:29,580 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:29,580 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:29,580 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:29,580 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:54:29,998 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130545e3bad539d42c49696fd48920a8009 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130545e3bad539d42c49696fd48920a8009 2023-03-20 10:54:30,403 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/ca03cd12b5d84124a52986c355f97f48 2023-03-20 10:54:30,410 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/ca03cd12b5d84124a52986c355f97f48 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ca03cd12b5d84124a52986c355f97f48 2023-03-20 10:54:30,414 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ca03cd12b5d84124a52986c355f97f48, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-20 10:54:30,415 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 835ms, sequenceid=5, compaction requested=false 2023-03-20 10:54:30,415 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:30,415 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:30,415 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:30,416 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:30,416 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:30,416 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,416 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:30,416 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:30,417 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,417 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:30,417 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,417 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14ac1e8b[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:30,419 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:30,419 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,419 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,420 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:30,420 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:30,420 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,420 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:30,420 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:30,421 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,421 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:30,421 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:30,421 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:30,423 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:30,424 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:30,424 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:30,424 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,424 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:30,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:30,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:30,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:30,425 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,427 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,428 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,428 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:30,428 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:30,428 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:30,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:30,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:30,428 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:30,428 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:30,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:30,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,429 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:30,429 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:30,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,429 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,529 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:30,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:30,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:30,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:30,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,537 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:30,537 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:30,537 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:30,537 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:30,538 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,538 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,539 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:30,539 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:30,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:30,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,541 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,542 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:30,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:30,542 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:30,542 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:30,542 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:30,542 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:30,542 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:30,542 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:30,542 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:30,543 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:54:30,964 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d47881ebcf2b4848a67f8994558bb9ed to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128d47881ebcf2b4848a67f8994558bb9ed 2023-03-20 10:54:31,371 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/d31992d380ea45059c1dbc3113c19e77 2023-03-20 10:54:31,378 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/d31992d380ea45059c1dbc3113c19e77 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d31992d380ea45059c1dbc3113c19e77 2023-03-20 10:54:31,383 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d31992d380ea45059c1dbc3113c19e77, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:54:31,384 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 841ms, sequenceid=9, compaction requested=false 2023-03-20 10:54:31,384 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:31,384 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:31,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:31,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:31,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:31,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:31,387 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,387 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:31,387 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,387 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c41c1e7[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:31,388 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:31,388 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,390 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:31,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:31,390 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,390 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:31,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:31,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:31,391 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:31,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:31,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:31,393 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:31,393 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:31,393 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:31,393 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,393 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:31,394 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,394 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:31,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,394 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:31,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:31,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:31,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:31,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:31,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:31,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,396 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:31,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,397 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,397 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:31,397 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,397 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:31,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:31,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:31,497 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:31,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:31,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,512 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:31,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:31,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:31,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:31,513 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,513 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,515 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:31,515 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:31,516 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:31,516 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,518 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:31,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:31,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:31,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:31,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:31,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:31,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:31,519 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:31,519 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:31,519 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:31,938 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013a14ba0025c4451c97672d47e109213d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013a14ba0025c4451c97672d47e109213d 2023-03-20 10:54:32,344 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/754f08106ccb4e6c9b76f691c3a7fc90 2023-03-20 10:54:32,348 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/754f08106ccb4e6c9b76f691c3a7fc90 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/754f08106ccb4e6c9b76f691c3a7fc90 2023-03-20 10:54:32,352 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/754f08106ccb4e6c9b76f691c3a7fc90, entries=1, sequenceid=13, filesize=4.9 K 2023-03-20 10:54:32,353 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 834ms, sequenceid=13, compaction requested=true 2023-03-20 10:54:32,353 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:32,353 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:32,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:32,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:32,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:32,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:32,354 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,354 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:32,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:32,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:32,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b594943[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:32,356 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:32,356 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,357 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:32,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:32,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:32,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:32,360 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:32,361 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:32,361 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:32,361 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,361 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:32,362 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,362 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:32,362 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:32,362 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,363 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:32,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:32,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,365 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:32,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:32,365 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,366 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:32,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:32,366 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,366 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,366 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,466 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:32,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:32,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:32,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:32,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,472 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:32,472 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:32,472 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:32,472 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:32,473 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,473 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:32,473 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:32,474 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:32,474 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,474 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:32,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:32,475 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:32,475 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:32,475 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:32,475 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:32,475 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:32,475 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:32,475 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:32,475 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:32,891 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f8c1840a1d0d4d8983b088b234cbb8d4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205f8c1840a1d0d4d8983b088b234cbb8d4 2023-03-20 10:54:33,296 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/41b321e130d6416fb3beb0ac810dbac5 2023-03-20 10:54:33,303 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/41b321e130d6416fb3beb0ac810dbac5 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/41b321e130d6416fb3beb0ac810dbac5 2023-03-20 10:54:33,310 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/41b321e130d6416fb3beb0ac810dbac5, entries=1, sequenceid=17, filesize=4.9 K 2023-03-20 10:54:33,311 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 836ms, sequenceid=17, compaction requested=true 2023-03-20 10:54:33,311 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:33,311 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:33,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:33,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:33,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:33,311 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:33,312 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,312 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:33,313 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:33,313 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:33,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:33,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bd6fad6[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:33,314 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:33,314 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,315 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,315 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:33,315 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:33,315 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:33,315 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,315 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:33,316 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:33,316 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,316 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:33,316 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:33,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:33,318 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:33,318 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:33,318 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:33,318 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,318 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:33,319 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,319 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:33,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,319 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:33,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:33,320 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,320 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,322 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:33,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:33,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:33,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:33,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:33,322 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:33,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:33,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:33,423 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:33,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:33,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:33,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:33,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,438 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:33,438 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:33,438 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:33,438 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:33,440 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,440 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,443 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:33,444 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:33,444 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:33,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,446 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,447 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:33,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:33,447 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:33,447 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:33,448 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:33,448 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:33,448 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:33,448 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:33,448 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:33,449 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:33,868 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228eac2057453e14ec6bfa133c9e620512d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228eac2057453e14ec6bfa133c9e620512d 2023-03-20 10:54:34,090 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:54:34,275 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/1d7fcef57b0c4926a32761bf1ae61828 2023-03-20 10:54:34,280 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/1d7fcef57b0c4926a32761bf1ae61828 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1d7fcef57b0c4926a32761bf1ae61828 2023-03-20 10:54:34,285 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1d7fcef57b0c4926a32761bf1ae61828, entries=1, sequenceid=21, filesize=4.9 K 2023-03-20 10:54:34,286 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 836ms, sequenceid=21, compaction requested=true 2023-03-20 10:54:34,286 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:34,286 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:34,286 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:34,286 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:34,286 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,286 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:34,286 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:34,287 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,287 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:34,287 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,288 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:34,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:34,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ffaf761[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:34,289 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:34,289 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,290 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:34,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:34,290 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:34,290 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,290 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:34,291 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:34,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:34,291 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:34,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:34,293 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:34,293 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:34,293 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:34,293 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,293 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:34,294 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,294 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:34,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,294 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:34,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:34,295 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,296 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:34,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:34,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:34,298 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:34,298 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,299 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:34,299 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,299 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,399 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:34,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:34,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:34,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:34,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,407 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:34,407 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:34,407 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:34,407 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:34,407 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,407 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,408 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:34,408 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:34,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:34,409 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:34,409 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:34,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:34,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:34,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:34,411 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:34,411 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:34,411 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:34,831 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123165bbc0c5dc7644078740a83ea4640e09 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123165bbc0c5dc7644078740a83ea4640e09 2023-03-20 10:54:35,241 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/77223fe4c60345179d442b45af18c5f1 2023-03-20 10:54:35,252 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/77223fe4c60345179d442b45af18c5f1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/77223fe4c60345179d442b45af18c5f1 2023-03-20 10:54:35,258 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/77223fe4c60345179d442b45af18c5f1, entries=1, sequenceid=25, filesize=4.9 K 2023-03-20 10:54:35,259 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 848ms, sequenceid=25, compaction requested=true 2023-03-20 10:54:35,259 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:35,259 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:35,259 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:35,259 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:35,259 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,259 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:35,259 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:35,261 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,261 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:35,261 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,261 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc65d80[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:35,263 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:35,263 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,264 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,264 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:35,264 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:35,264 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:35,264 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,264 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:35,265 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:35,265 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,265 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,265 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:35,268 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:35,268 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:35,268 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:35,268 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,268 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:35,270 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,270 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,270 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:35,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,270 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:35,272 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:35,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:35,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:35,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:35,274 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:35,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:35,274 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:35,275 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,275 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,275 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,375 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:35,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:35,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:35,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:35,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,382 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:35,382 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:35,382 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:35,382 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:35,383 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,383 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,387 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:35,387 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:35,388 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:35,388 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,388 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:35,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:35,389 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:35,389 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:35,389 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:35,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:35,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:35,390 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:35,390 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:35,390 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:35,804 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101276d03b7875b40c08dd25228ae1296c5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101276d03b7875b40c08dd25228ae1296c5 2023-03-20 10:54:36,210 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/d9dc7fbb829747198035478d9621681d 2023-03-20 10:54:36,222 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/d9dc7fbb829747198035478d9621681d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d9dc7fbb829747198035478d9621681d 2023-03-20 10:54:36,228 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d9dc7fbb829747198035478d9621681d, entries=1, sequenceid=29, filesize=4.9 K 2023-03-20 10:54:36,229 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 839ms, sequenceid=29, compaction requested=true 2023-03-20 10:54:36,229 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:36,229 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:36,229 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:36,229 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:36,229 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,229 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:36,229 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:36,230 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,230 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:36,231 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,231 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:36,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:36,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c440c2a[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:36,233 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:36,233 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,234 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,234 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:36,234 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:36,234 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:36,234 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,234 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:36,235 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:36,235 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,235 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:36,235 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:36,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:36,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:36,238 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:36,238 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:36,238 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:36,238 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,238 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:36,239 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,239 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,239 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:36,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:36,240 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,241 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,244 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,244 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:36,244 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:36,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:36,244 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:36,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:36,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:36,245 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:36,246 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:36,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:36,346 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:36,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:36,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:36,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:36,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,355 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:36,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:36,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:36,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:36,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,356 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,357 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:36,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:36,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:36,358 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:36,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:36,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:36,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:36,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:36,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:36,361 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:36,361 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:36,361 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:36,362 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:36,777 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ef279a9cbf3f4720a42e922668a3d37a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ef279a9cbf3f4720a42e922668a3d37a 2023-03-20 10:54:37,184 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/2992856047eb455aabbd8ee29db7fcaf 2023-03-20 10:54:37,194 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/2992856047eb455aabbd8ee29db7fcaf as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/2992856047eb455aabbd8ee29db7fcaf 2023-03-20 10:54:37,200 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/2992856047eb455aabbd8ee29db7fcaf, entries=1, sequenceid=33, filesize=4.9 K 2023-03-20 10:54:37,201 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 839ms, sequenceid=33, compaction requested=true 2023-03-20 10:54:37,201 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:37,201 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:37,201 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:37,201 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:37,201 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,201 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:37,201 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:37,202 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,202 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:37,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:37,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2068473e[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:37,205 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:37,205 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,207 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:37,207 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:37,207 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:37,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:37,208 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:37,209 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:37,209 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:37,208 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:37,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:37,214 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:37,214 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:37,214 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:37,214 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,214 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:37,217 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,217 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:37,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,217 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:37,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:37,217 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,219 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:37,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:37,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:37,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:37,224 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:37,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:37,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,225 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,225 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,225 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:37,225 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:37,225 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:37,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:37,325 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:37,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:37,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:37,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:37,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,332 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:37,332 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:37,332 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:37,332 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:37,333 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,333 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,334 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,334 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,334 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:37,334 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:37,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:37,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,335 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:37,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:37,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:37,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:37,338 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:37,338 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:37,338 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:37,338 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:37,338 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:37,756 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907acaba2d3375e4158a54e5a01af430e44 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907acaba2d3375e4158a54e5a01af430e44 2023-03-20 10:54:37,767 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/ac42b34f61cc4465a7b0ff76341ebbe2 2023-03-20 10:54:37,778 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/ac42b34f61cc4465a7b0ff76341ebbe2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ac42b34f61cc4465a7b0ff76341ebbe2 2023-03-20 10:54:37,783 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ac42b34f61cc4465a7b0ff76341ebbe2, entries=1, sequenceid=37, filesize=4.9 K 2023-03-20 10:54:37,784 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 446ms, sequenceid=37, compaction requested=true 2023-03-20 10:54:37,784 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:37,784 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:37,784 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:37,784 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:37,784 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,784 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:37,784 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:37,785 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,786 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:37,786 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,786 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:37,787 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1811fdad[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:37,787 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,788 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:37,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:37,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:37,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:37,789 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:37,789 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,789 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:37,789 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:37,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:37,793 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:37,793 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:37,793 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:37,793 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,793 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:37,794 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,794 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:37,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:37,794 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:37,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,795 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:37,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,796 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:37,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:37,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:37,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:37,798 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,798 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,798 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,798 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,797 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:37,797 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:37,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:37,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:37,898 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:37,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:37,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:37,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:37,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,905 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:37,905 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:37,905 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-20 10:54:37,905 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-20 10:54:37,906 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,906 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,906 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:37,906 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:37,907 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:37,907 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,908 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-20 10:54:37,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:37,908 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-20 10:54:37,908 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:37,908 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-20 10:54:37,908 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:37,908 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:37,908 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:37,908 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. started... 2023-03-20 10:54:37,908 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d04a13b1886cbfc7a73fc35394f94d65 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:38,325 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120edd84a6d691841a8bda9442684a96cb3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120edd84a6d691841a8bda9442684a96cb3 2023-03-20 10:54:38,730 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/1170fb5ea5ef4cf79147cab0558cf35f 2023-03-20 10:54:38,735 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/1170fb5ea5ef4cf79147cab0558cf35f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1170fb5ea5ef4cf79147cab0558cf35f 2023-03-20 10:54:38,739 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1170fb5ea5ef4cf79147cab0558cf35f, entries=1, sequenceid=41, filesize=4.9 K 2023-03-20 10:54:38,740 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d04a13b1886cbfc7a73fc35394f94d65 in 832ms, sequenceid=41, compaction requested=true 2023-03-20 10:54:38,740 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:38,740 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:38,740 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:38,740 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:38,740 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,740 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-20 10:54:38,740 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-20 10:54:38,741 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,741 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:38,741 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:38,741 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:38,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-20 10:54:38,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37948972[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:38,742 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-20 10:54:38,743 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,743 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,743 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-20 10:54:38,743 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-20 10:54:38,743 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:38,743 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,743 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:38,744 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-20 10:54:38,744 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:38,744 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,744 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-20 10:54:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:38,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:54:38,746 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-20 10:54:38,746 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:38,746 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:38,746 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,746 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:38,747 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,747 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:38,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,747 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:38,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:38,747 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,749 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:38,753 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:38,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:38,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-20 10:54:38,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-20 10:54:38,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:38,753 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,754 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:38,754 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:38,854 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:38,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:38,855 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-20 10:54:38,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:38,858 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:38,859 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:38,859 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310278859 2023-03-20 10:54:38,868 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:54:38,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-20 10:54:38,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:38,869 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x23d51dcb to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:38,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dc794d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:38,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,744 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036f18f3a9c1b04080aca3645165cb2101 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601036f18f3a9c1b04080aca3645165cb2101 2023-03-20 10:54:39,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:39,757 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:54:39,758 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56374, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:54:39,765 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:54:39,766 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:54:39,781 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/187ab6a9b82a4d628b0f98b4dc6e1840 first=Optional[r3] last=Optional[r6] 2023-03-20 10:54:39,782 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/187ab6a9b82a4d628b0f98b4dc6e1840}] 2023-03-20 10:54:39,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/187ab6a9b82a4d628b0f98b4dc6e1840 for inclusion in d04a13b1886cbfc7a73fc35394f94d65/family1 2023-03-20 10:54:39,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-20 10:54:39,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/187ab6a9b82a4d628b0f98b4dc6e1840 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__spqnlj6jm8j32bagiv4q1njur948svrv8n4g0i98tvh1khrup7fa86u8v54pin5m/family1/187ab6a9b82a4d628b0f98b4dc6e1840 2023-03-20 10:54:39,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__spqnlj6jm8j32bagiv4q1njur948svrv8n4g0i98tvh1khrup7fa86u8v54pin5m/family1/187ab6a9b82a4d628b0f98b4dc6e1840 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_ 2023-03-20 10:54:39,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__spqnlj6jm8j32bagiv4q1njur948svrv8n4g0i98tvh1khrup7fa86u8v54pin5m/family1/187ab6a9b82a4d628b0f98b4dc6e1840 into d04a13b1886cbfc7a73fc35394f94d65/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_ - updating store file list. 2023-03-20 10:54:39,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_ into d04a13b1886cbfc7a73fc35394f94d65/family1 2023-03-20 10:54:39,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__spqnlj6jm8j32bagiv4q1njur948svrv8n4g0i98tvh1khrup7fa86u8v54pin5m/family1/187ab6a9b82a4d628b0f98b4dc6e1840 into d04a13b1886cbfc7a73fc35394f94d65/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_) 2023-03-20 10:54:39,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__spqnlj6jm8j32bagiv4q1njur948svrv8n4g0i98tvh1khrup7fa86u8v54pin5m/family1/187ab6a9b82a4d628b0f98b4dc6e1840 2023-03-20 10:54:39,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:54:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:54:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): d04a13b1886cbfc7a73fc35394f94d65/family1 is initiating minor compaction 2023-03-20 10:54:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@725e8b3b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:39,801 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d04a13b1886cbfc7a73fc35394f94d65/family1 in testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:39,801 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d31992d380ea45059c1dbc3113c19e77, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/754f08106ccb4e6c9b76f691c3a7fc90, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/41b321e130d6416fb3beb0ac810dbac5, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1d7fcef57b0c4926a32761bf1ae61828, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/77223fe4c60345179d442b45af18c5f1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d9dc7fbb829747198035478d9621681d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/2992856047eb455aabbd8ee29db7fcaf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ac42b34f61cc4465a7b0ff76341ebbe2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1170fb5ea5ef4cf79147cab0558cf35f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp, totalSize=50.0 K 2023-03-20 10:54:39,801 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting d31992d380ea45059c1dbc3113c19e77, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:54:39,801 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 754f08106ccb4e6c9b76f691c3a7fc90, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:54:39,801 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 41b321e130d6416fb3beb0ac810dbac5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 1d7fcef57b0c4926a32761bf1ae61828, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 77223fe4c60345179d442b45af18c5f1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting d9dc7fbb829747198035478d9621681d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 2992856047eb455aabbd8ee29db7fcaf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ac42b34f61cc4465a7b0ff76341ebbe2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 1170fb5ea5ef4cf79147cab0558cf35f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:54:39,802 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 585775683f594c4da74919e70f4a6bf8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:54:39,803 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:39,804 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:39,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228eac2057453e14ec6bfa133c9e620512d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228eac2057453e14ec6bfa133c9e620512d 2023-03-20 10:54:39,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123165bbc0c5dc7644078740a83ea4640e09 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123165bbc0c5dc7644078740a83ea4640e09 2023-03-20 10:54:39,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101276d03b7875b40c08dd25228ae1296c5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101276d03b7875b40c08dd25228ae1296c5 2023-03-20 10:54:39,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ef279a9cbf3f4720a42e922668a3d37a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ef279a9cbf3f4720a42e922668a3d37a 2023-03-20 10:54:39,809 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-20 10:54:39,809 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:39,836 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): d04a13b1886cbfc7a73fc35394f94d65#family1#compaction#49 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:40,651 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/698342a18aef424bb2eea8c75caabaaa as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/698342a18aef424bb2eea8c75caabaaa 2023-03-20 10:54:40,656 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d04a13b1886cbfc7a73fc35394f94d65/family1 of d04a13b1886cbfc7a73fc35394f94d65 into 698342a18aef424bb2eea8c75caabaaa(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:40,656 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:40,656 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679309679801; duration=0sec 2023-03-20 10:54:40,657 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:40,670 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052fdd6a7ffebd4e17ba4b7e7310e18748 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512052fdd6a7ffebd4e17ba4b7e7310e18748 2023-03-20 10:54:40,671 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:40,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d31992d380ea45059c1dbc3113c19e77, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/754f08106ccb4e6c9b76f691c3a7fc90, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/41b321e130d6416fb3beb0ac810dbac5, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1d7fcef57b0c4926a32761bf1ae61828, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/77223fe4c60345179d442b45af18c5f1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d9dc7fbb829747198035478d9621681d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/2992856047eb455aabbd8ee29db7fcaf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ac42b34f61cc4465a7b0ff76341ebbe2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1170fb5ea5ef4cf79147cab0558cf35f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_] to archive 2023-03-20 10:54:40,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:40,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d31992d380ea45059c1dbc3113c19e77 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d31992d380ea45059c1dbc3113c19e77 2023-03-20 10:54:40,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/754f08106ccb4e6c9b76f691c3a7fc90 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/754f08106ccb4e6c9b76f691c3a7fc90 2023-03-20 10:54:40,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/41b321e130d6416fb3beb0ac810dbac5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/41b321e130d6416fb3beb0ac810dbac5 2023-03-20 10:54:40,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1d7fcef57b0c4926a32761bf1ae61828 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1d7fcef57b0c4926a32761bf1ae61828 2023-03-20 10:54:40,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/77223fe4c60345179d442b45af18c5f1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/77223fe4c60345179d442b45af18c5f1 2023-03-20 10:54:40,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d9dc7fbb829747198035478d9621681d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/d9dc7fbb829747198035478d9621681d 2023-03-20 10:54:40,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/2992856047eb455aabbd8ee29db7fcaf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/2992856047eb455aabbd8ee29db7fcaf 2023-03-20 10:54:40,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ac42b34f61cc4465a7b0ff76341ebbe2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ac42b34f61cc4465a7b0ff76341ebbe2 2023-03-20 10:54:40,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1170fb5ea5ef4cf79147cab0558cf35f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/1170fb5ea5ef4cf79147cab0558cf35f 2023-03-20 10:54:40,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/585775683f594c4da74919e70f4a6bf8_SeqId_44_ 2023-03-20 10:54:40,738 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/373d321ce5c64d22b62e15b8f8bee50e first=Optional[r00] last=Optional[r2] 2023-03-20 10:54:40,742 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/373d321ce5c64d22b62e15b8f8bee50e}] 2023-03-20 10:54:40,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/373d321ce5c64d22b62e15b8f8bee50e for inclusion in d04a13b1886cbfc7a73fc35394f94d65/family1 2023-03-20 10:54:40,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-20 10:54:40,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:40,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:40,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/373d321ce5c64d22b62e15b8f8bee50e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p42rdkl9f2rdo5ge6u2ga8nrvni21bo41fl1h52t479vldn8jrvncp0sao5igprl/family1/373d321ce5c64d22b62e15b8f8bee50e 2023-03-20 10:54:40,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p42rdkl9f2rdo5ge6u2ga8nrvni21bo41fl1h52t479vldn8jrvncp0sao5igprl/family1/373d321ce5c64d22b62e15b8f8bee50e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_ 2023-03-20 10:54:40,757 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p42rdkl9f2rdo5ge6u2ga8nrvni21bo41fl1h52t479vldn8jrvncp0sao5igprl/family1/373d321ce5c64d22b62e15b8f8bee50e into d04a13b1886cbfc7a73fc35394f94d65/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_ - updating store file list. 2023-03-20 10:54:40,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_ into d04a13b1886cbfc7a73fc35394f94d65/family1 2023-03-20 10:54:40,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p42rdkl9f2rdo5ge6u2ga8nrvni21bo41fl1h52t479vldn8jrvncp0sao5igprl/family1/373d321ce5c64d22b62e15b8f8bee50e into d04a13b1886cbfc7a73fc35394f94d65/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_) 2023-03-20 10:54:40,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p42rdkl9f2rdo5ge6u2ga8nrvni21bo41fl1h52t479vldn8jrvncp0sao5igprl/family1/373d321ce5c64d22b62e15b8f8bee50e 2023-03-20 10:54:40,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:54:40,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:54:40,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): d04a13b1886cbfc7a73fc35394f94d65/family1 is initiating minor compaction (all files) 2023-03-20 10:54:40,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@341e3549; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:40,765 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d04a13b1886cbfc7a73fc35394f94d65/family1 in testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:54:40,765 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ca03cd12b5d84124a52986c355f97f48, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/698342a18aef424bb2eea8c75caabaaa, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp, totalSize=337.0 K 2023-03-20 10:54:40,765 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ca03cd12b5d84124a52986c355f97f48, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:54:40,766 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 698342a18aef424bb2eea8c75caabaaa, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:54:40,766 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878847712 2023-03-20 10:54:40,767 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:40,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:40,769 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130545e3bad539d42c49696fd48920a8009 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130545e3bad539d42c49696fd48920a8009 2023-03-20 10:54:40,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013a14ba0025c4451c97672d47e109213d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013a14ba0025c4451c97672d47e109213d 2023-03-20 10:54:40,771 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205f8c1840a1d0d4d8983b088b234cbb8d4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205f8c1840a1d0d4d8983b088b234cbb8d4 2023-03-20 10:54:40,771 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-20 10:54:40,771 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-20 10:54:40,772 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-20 10:54:40,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-20 10:54:40,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:40,773 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:54:40,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.9170 sec 2023-03-20 10:54:40,783 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): d04a13b1886cbfc7a73fc35394f94d65#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:40,895 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=254 (was 254), OpenFileDescriptor=621 (was 601) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=467 (was 543), ProcessCount=187 (was 187), AvailableMemoryMB=9067 (was 9153) 2023-03-20 10:54:40,907 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=254, OpenFileDescriptor=621, MaxFileDescriptor=60000, SystemLoadAverage=467, ProcessCount=187, AvailableMemoryMB=9066 2023-03-20 10:54:40,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-20 10:54:40,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:40,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:54:40,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-20 10:54:40,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:54:40,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-20 10:54:40,914 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:40,914 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf empty. 2023-03-20 10:54:40,915 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:40,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-20 10:54:41,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-20 10:54:41,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-20 10:54:41,217 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/.tmp/family1/c89216c125a249a8b7e8e447119ffa42 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/c89216c125a249a8b7e8e447119ffa42 2023-03-20 10:54:41,222 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d04a13b1886cbfc7a73fc35394f94d65/family1 of d04a13b1886cbfc7a73fc35394f94d65 into c89216c125a249a8b7e8e447119ffa42(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:41,222 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:54:41,223 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1679309680765; duration=0sec 2023-03-20 10:54:41,223 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:41,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ca03cd12b5d84124a52986c355f97f48, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/698342a18aef424bb2eea8c75caabaaa, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_] to archive 2023-03-20 10:54:41,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:41,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ca03cd12b5d84124a52986c355f97f48 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/ca03cd12b5d84124a52986c355f97f48 2023-03-20 10:54:41,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/698342a18aef424bb2eea8c75caabaaa to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/698342a18aef424bb2eea8c75caabaaa 2023-03-20 10:54:41,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/family1/dc0afef2caf8463090e1bc741b72bfbd_SeqId_47_ 2023-03-20 10:54:41,322 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-20 10:54:41,324 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a39e1d017ce37e865c8dff1d0d345bf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:41,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-20 10:54:41,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:41,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 1a39e1d017ce37e865c8dff1d0d345bf, disabling compactions & flushes 2023-03-20 10:54:41,729 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:41,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:41,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. after waiting 0 ms 2023-03-20 10:54:41,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:41,729 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:41,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:41,732 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:54:41,735 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309681734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309681734"}]},"ts":"1679309681734"} 2023-03-20 10:54:41,736 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:54:41,737 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:54:41,737 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309681737"}]},"ts":"1679309681737"} 2023-03-20 10:54:41,738 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-20 10:54:41,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, ASSIGN}] 2023-03-20 10:54:41,742 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, ASSIGN 2023-03-20 10:54:41,742 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:41,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:41,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309681893"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309681893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309681893"}]},"ts":"1679309681893"} 2023-03-20 10:54:41,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:42,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-20 10:54:42,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:42,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a39e1d017ce37e865c8dff1d0d345bf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:42,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:42,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,050 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,051 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:42,051 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:42,051 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a39e1d017ce37e865c8dff1d0d345bf columnFamilyName family1 2023-03-20 10:54:42,052 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(310): Store=1a39e1d017ce37e865c8dff1d0d345bf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:42,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:42,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:42,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1a39e1d017ce37e865c8dff1d0d345bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65465938, jitterRate=-0.024481505155563354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:42,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:42,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., pid=41, masterSystemTime=1679309682046 2023-03-20 10:54:42,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:42,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:42,060 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:42,060 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309682060"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309682060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309682060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309682060"}]},"ts":"1679309682060"} 2023-03-20 10:54:42,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-20 10:54:42,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230 in 167 msec 2023-03-20 10:54:42,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-20 10:54:42,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, ASSIGN in 323 msec 2023-03-20 10:54:42,065 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:54:42,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309682065"}]},"ts":"1679309682065"} 2023-03-20 10:54:42,066 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-20 10:54:42,068 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:54:42,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1580 sec 2023-03-20 10:54:43,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-20 10:54:43,018 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-20 10:54:43,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:43,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,055 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:43,055 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:43,055 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:43,056 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:43,056 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,056 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,057 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:43,057 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:43,057 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,057 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:43,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,058 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:43,058 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:43,058 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:43,058 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:43,058 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:43,058 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:43,058 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:43,059 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:54:43,102 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b23ce2f4f8d34c6c8f1b3723eabfdd34 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130b23ce2f4f8d34c6c8f1b3723eabfdd34 2023-03-20 10:54:43,507 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/e5e66072afcd4696a2887412244e47b0 2023-03-20 10:54:43,514 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/e5e66072afcd4696a2887412244e47b0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/e5e66072afcd4696a2887412244e47b0 2023-03-20 10:54:43,521 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/e5e66072afcd4696a2887412244e47b0, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-20 10:54:43,522 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 463ms, sequenceid=5, compaction requested=false 2023-03-20 10:54:43,522 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:43,523 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:43,523 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:43,523 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:43,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:43,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:43,524 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:43,528 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:43,528 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:43,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:43,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b9de6f6[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:43,533 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:43,533 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,541 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,541 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:43,541 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:43,541 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:43,541 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,541 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:43,550 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:43,550 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:43,550 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,550 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:43,552 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:43,552 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:43,552 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:43,553 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,553 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:43,557 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,557 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:43,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,557 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,558 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:43,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:43,560 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:43,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,561 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:43,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:43,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:43,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:43,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:43,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-20 10:54:43,562 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,562 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,562 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:43,562 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:43,562 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:43,662 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:43,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:43,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:43,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:43,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,669 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:43,669 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:43,669 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:43,669 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:43,669 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,670 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,670 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:43,670 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:43,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:43,671 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:43,671 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,672 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:43,672 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:43,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:43,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:43,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:43,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:43,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:43,672 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:43,672 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:43,672 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:54:44,096 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f67f9b22f10e4ee78d57c7c519638d21 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f67f9b22f10e4ee78d57c7c519638d21 2023-03-20 10:54:44,502 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/091111422a6f498db0238947b3754b3c 2023-03-20 10:54:44,509 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/091111422a6f498db0238947b3754b3c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/091111422a6f498db0238947b3754b3c 2023-03-20 10:54:44,516 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/091111422a6f498db0238947b3754b3c, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:54:44,517 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 845ms, sequenceid=9, compaction requested=false 2023-03-20 10:54:44,518 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:44,518 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:44,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:44,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:44,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:44,518 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:44,519 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,520 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,520 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:44,521 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:44,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:44,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79ae130c[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:44,524 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:44,524 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,525 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,525 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:44,525 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:44,525 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:44,525 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,525 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:44,526 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:44,526 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,526 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:44,526 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:44,530 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:44,530 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:44,530 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:44,530 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,530 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:44,532 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,532 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:44,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,533 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,534 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,534 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:44,537 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:44,537 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:44,537 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:44,538 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:44,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:44,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:44,537 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-20 10:54:44,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:44,538 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,539 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:44,539 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:44,640 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:44,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:44,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:44,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:44,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,650 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:44,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:44,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:44,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:44,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,651 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:44,651 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:44,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:44,651 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:44,651 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,653 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:44,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:44,653 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:44,653 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:44,653 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:44,653 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:44,653 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:44,653 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:44,653 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:44,653 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:44,802 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-20 10:54:45,069 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bba0f6f1b3b94a0c900f0c3ebeb84f81 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201bba0f6f1b3b94a0c900f0c3ebeb84f81 2023-03-20 10:54:45,080 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/a005b86e6a984038b6782dfc9c7993c9 2023-03-20 10:54:45,091 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/a005b86e6a984038b6782dfc9c7993c9 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/a005b86e6a984038b6782dfc9c7993c9 2023-03-20 10:54:45,101 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/a005b86e6a984038b6782dfc9c7993c9, entries=1, sequenceid=13, filesize=5.0 K 2023-03-20 10:54:45,102 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 449ms, sequenceid=13, compaction requested=true 2023-03-20 10:54:45,102 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:45,102 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:45,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:45,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:45,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:45,103 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:45,106 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:45,106 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,110 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,110 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:45,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ec56501[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:45,123 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:45,123 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,125 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,125 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:45,126 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:45,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:45,126 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:45,127 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:45,127 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:45,127 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:45,131 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:45,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:45,135 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:45,135 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:45,135 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:45,135 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,135 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:45,150 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,150 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:45,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,150 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:45,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:45,151 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,152 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:45,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,160 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:45,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:45,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:45,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:45,160 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,161 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,161 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,261 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:45,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:45,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:45,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:45,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,269 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:45,269 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:45,269 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:45,269 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:45,269 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,269 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,270 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,270 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:45,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:45,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:45,270 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,270 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:45,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,271 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:45,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,274 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:45,274 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:45,274 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:45,274 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:45,274 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:45,324 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:45,324 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:45,324 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:45,324 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-20 10:54:45,326 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:54:45,326 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23d51dcb to 127.0.0.1:62837 2023-03-20 10:54:45,326 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:54:45,326 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:54:45,327 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x588ef04d to 127.0.0.1:62837 2023-03-20 10:54:45,327 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:54:45,327 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:54:45,327 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x740e57e3 to 127.0.0.1:62837 2023-03-20 10:54:45,327 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:54:45,346 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a2dbf6b2875c4202832a8466e9e0db40 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2dbf6b2875c4202832a8466e9e0db40 2023-03-20 10:54:45,351 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/d6d73dbf13ad489faa83ab77a006c35c 2023-03-20 10:54:45,356 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/d6d73dbf13ad489faa83ab77a006c35c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/d6d73dbf13ad489faa83ab77a006c35c 2023-03-20 10:54:45,362 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/d6d73dbf13ad489faa83ab77a006c35c, entries=1, sequenceid=17, filesize=5.0 K 2023-03-20 10:54:45,371 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 47ms, sequenceid=17, compaction requested=true 2023-03-20 10:54:45,371 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:45,371 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:45,371 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:45,371 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:45,371 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,371 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:45,371 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:45,431 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,431 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:45,431 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,431 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:45,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:45,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d09aeb2[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:45,433 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:45,433 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,433 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,434 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:45,434 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:45,434 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:45,434 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,435 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:45,435 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:45,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:45,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:45,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:45,437 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:45,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:45,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:45,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,437 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:45,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:45,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:45,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,442 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,444 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,445 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:45,446 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:45,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:45,446 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:45,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:45,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:45,547 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:45,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:45,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:45,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:45,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,572 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:45,572 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:45,572 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:45,572 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:45,574 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,574 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,586 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:45,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:45,586 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:45,587 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:45,587 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:45,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:45,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,587 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,589 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:45,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:45,589 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:45,589 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:45,589 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:45,589 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:45,589 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:45,589 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:45,590 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:45,590 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:45,604 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228782c540916994fed8dcb302fb82c4a02 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228782c540916994fed8dcb302fb82c4a02 2023-03-20 10:54:46,011 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/dc2e4c8301174baa8f3ff0f6485eee12 2023-03-20 10:54:46,018 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/dc2e4c8301174baa8f3ff0f6485eee12 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/dc2e4c8301174baa8f3ff0f6485eee12 2023-03-20 10:54:46,023 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/dc2e4c8301174baa8f3ff0f6485eee12, entries=1, sequenceid=21, filesize=5.0 K 2023-03-20 10:54:46,024 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 434ms, sequenceid=21, compaction requested=true 2023-03-20 10:54:46,024 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:46,024 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:46,025 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,025 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:46,025 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,025 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:46,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:46,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9d75db3[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:46,027 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:46,027 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,028 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,028 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:46,030 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,030 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:46,030 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:46,030 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:46,035 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:46,035 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:46,035 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:46,036 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:46,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:46,071 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:46,071 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:46,071 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:46,071 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,071 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:46,096 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,096 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:46,096 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:46,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,098 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,099 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:46,102 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:46,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:46,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:46,103 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:46,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-20 10:54:46,102 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:46,103 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:46,103 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,103 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,204 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:46,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:46,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:46,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:46,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,221 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:46,221 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:46,221 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:46,221 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:46,222 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,222 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,223 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,228 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:46,229 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,229 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:46,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:46,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:46,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,238 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:46,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,238 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:46,238 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:46,238 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:46,239 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:46,239 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:46,239 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:46,239 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:46,239 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:46,283 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123148f718ba09f341d391edd2802b898cab to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123148f718ba09f341d391edd2802b898cab 2023-03-20 10:54:46,316 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/ddc52f102ad2478e990265ff5a8f3bee 2023-03-20 10:54:46,323 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/ddc52f102ad2478e990265ff5a8f3bee as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/ddc52f102ad2478e990265ff5a8f3bee 2023-03-20 10:54:46,329 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/ddc52f102ad2478e990265ff5a8f3bee, entries=1, sequenceid=25, filesize=5.0 K 2023-03-20 10:54:46,331 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 92ms, sequenceid=25, compaction requested=true 2023-03-20 10:54:46,331 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:46,331 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:46,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:46,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:46,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:46,334 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:46,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,335 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:46,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,336 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:46,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:46,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:46,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6819f6[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:46,337 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:46,337 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:46,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,342 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:46,342 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:46,342 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:46,350 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,350 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:46,350 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:46,350 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:46,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:46,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:46,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:46,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:46,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:46,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:46,355 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:46,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:46,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:46,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,355 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:46,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:46,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:46,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:46,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,359 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:46,361 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:46,367 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:46,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:46,367 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:46,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:46,468 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:46,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:46,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:46,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:46,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,475 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:46,475 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:46,475 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:46,475 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:46,476 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,476 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,477 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,477 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:46,477 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:46,477 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:46,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,478 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:46,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:46,479 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:46,479 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:46,479 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:46,479 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:46,479 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:46,479 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:46,479 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:46,479 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:46,910 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012e66d7eb775847afa8b2872f767dc33f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012e66d7eb775847afa8b2872f767dc33f 2023-03-20 10:54:47,315 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/fb0079f757924200bca09aa8d8045822 2023-03-20 10:54:47,320 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/fb0079f757924200bca09aa8d8045822 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/fb0079f757924200bca09aa8d8045822 2023-03-20 10:54:47,324 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/fb0079f757924200bca09aa8d8045822, entries=1, sequenceid=29, filesize=5.0 K 2023-03-20 10:54:47,325 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 846ms, sequenceid=29, compaction requested=true 2023-03-20 10:54:47,325 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:47,325 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:47,326 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:47,326 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:47,326 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,326 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:47,326 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:47,327 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:47,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:47,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:47,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:47,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:47,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45c08997[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:47,328 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:47,328 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,329 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:47,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:47,329 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:47,329 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,330 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:47,331 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:47,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:47,331 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:47,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:47,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:47,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:47,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:47,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:47,334 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:47,334 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:47,334 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:47,334 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,334 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:47,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:47,335 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:47,335 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,337 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:47,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:47,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:47,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:47,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:47,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:47,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:47,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:47,339 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:47,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:47,339 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:47,439 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:47,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:47,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:47,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:47,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,447 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:47,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:47,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:47,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:47,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,447 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:47,448 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:47,448 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,448 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:47,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,450 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:47,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:47,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:47,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:47,454 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:47,454 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:47,454 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:47,454 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:47,454 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:47,480 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e636d50722094956bc1911b6416d73ac to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e636d50722094956bc1911b6416d73ac 2023-03-20 10:54:47,605 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:54:47,892 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/f1da339612bc4c768daff5a14e73a21b 2023-03-20 10:54:47,902 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/f1da339612bc4c768daff5a14e73a21b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/f1da339612bc4c768daff5a14e73a21b 2023-03-20 10:54:47,908 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/f1da339612bc4c768daff5a14e73a21b, entries=1, sequenceid=33, filesize=5.0 K 2023-03-20 10:54:47,909 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 455ms, sequenceid=33, compaction requested=true 2023-03-20 10:54:47,909 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:47,909 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:47,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:47,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:47,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:47,910 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:47,911 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,911 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:47,911 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,911 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:47,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:47,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@758cd3a3[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:47,913 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:47,913 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,914 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,914 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:47,914 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:47,914 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:47,914 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,914 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:47,915 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:47,915 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:47,915 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,915 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:47,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:47,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:47,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:47,920 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:47,920 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:47,920 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:47,920 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,920 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:47,922 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,922 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:47,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,922 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:47,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:47,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:47,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,923 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,924 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,926 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,927 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,927 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,927 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:47,927 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,927 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,927 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:47,927 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:47,930 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:47,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:47,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:47,930 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:47,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:47,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:47,934 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:47,934 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:48,034 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:48,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:48,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:48,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:48,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,041 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:48,041 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:48,041 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:48,041 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:48,041 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,041 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,042 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,042 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:48,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:48,042 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,042 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,043 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:48,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,043 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:48,043 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:48,043 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:48,043 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:48,043 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:48,043 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:48,043 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:48,044 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:48,460 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cd408cfdb0e44cb5a91f90f91ad3cfb8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907cd408cfdb0e44cb5a91f90f91ad3cfb8 2023-03-20 10:54:48,866 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/b2cd2bfc8cce43398eb469a8f69a0032 2023-03-20 10:54:48,871 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/b2cd2bfc8cce43398eb469a8f69a0032 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/b2cd2bfc8cce43398eb469a8f69a0032 2023-03-20 10:54:48,875 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/b2cd2bfc8cce43398eb469a8f69a0032, entries=1, sequenceid=37, filesize=5.0 K 2023-03-20 10:54:48,876 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 832ms, sequenceid=37, compaction requested=true 2023-03-20 10:54:48,877 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:48,877 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:48,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:48,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:48,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:48,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:48,878 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,878 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:48,878 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,878 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:48,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:48,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:48,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46053264[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:48,879 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:48,879 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,881 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,881 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,882 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:48,882 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:48,882 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:48,882 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:48,883 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,883 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:48,883 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:48,883 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:48,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:48,885 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:48,885 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:48,885 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:48,885 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,885 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:48,886 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,886 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:48,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,886 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:48,886 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,887 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:48,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,890 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-20 10:54:48,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:48,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:48,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:48,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:48,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:48,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,890 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:48,991 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:48,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:48,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:48,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:48,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,997 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-20 10:54:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-20 10:54:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,998 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,998 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:48,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:48,999 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:48,999 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:48,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,000 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-20 10:54:49,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,000 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-20 10:54:49,000 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:49,000 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-20 10:54:49,000 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:49,000 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:49,000 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:49,000 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. started... 2023-03-20 10:54:49,000 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1a39e1d017ce37e865c8dff1d0d345bf 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:49,412 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208fad25f6cf414acf9cca02aa93290ddc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208fad25f6cf414acf9cca02aa93290ddc 2023-03-20 10:54:49,423 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/20583304903d4ce7a295d96e0626892e 2023-03-20 10:54:49,428 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/20583304903d4ce7a295d96e0626892e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/20583304903d4ce7a295d96e0626892e 2023-03-20 10:54:49,434 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/20583304903d4ce7a295d96e0626892e, entries=1, sequenceid=41, filesize=5.0 K 2023-03-20 10:54:49,435 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1a39e1d017ce37e865c8dff1d0d345bf in 435ms, sequenceid=41, compaction requested=true 2023-03-20 10:54:49,435 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:49,435 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:49,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:49,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:49,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-20 10:54:49,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-20 10:54:49,436 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,436 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:49,437 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,437 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:49,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-20 10:54:49,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66234fb[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:49,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-20 10:54:49,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,458 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,458 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-20 10:54:49,458 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-20 10:54:49,458 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:49,459 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,459 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:49,466 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-20 10:54:49,466 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,466 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:49,466 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-20 10:54:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:49,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-20 10:54:49,468 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-20 10:54:49,468 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:49,468 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:49,468 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,468 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:49,469 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,469 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,470 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:49,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:49,470 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,471 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:49,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-20 10:54:49,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:49,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:49,474 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:49,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-20 10:54:49,473 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,474 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,474 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,473 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:49,474 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:49,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:49,474 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:49,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:49,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:49,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:49,574 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:49,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:49,576 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:49,578 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:49,579 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:49,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:49,579 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310289579 2023-03-20 10:54:49,581 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:54:49,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-20 10:54:49,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:49,583 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x652b92b4 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:49,586 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4abc3f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:49,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,431 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb234b28623e48aeab51b0093a1f21ca to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb234b28623e48aeab51b0093a1f21ca 2023-03-20 10:54:50,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:50,448 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:54:50,450 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:54:50,456 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:54:50,458 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56622, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:54:50,468 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5ba91245a63450a80c83b9313e1f459 first=Optional[r3] last=Optional[r6] 2023-03-20 10:54:50,469 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5ba91245a63450a80c83b9313e1f459}] 2023-03-20 10:54:50,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5ba91245a63450a80c83b9313e1f459 for inclusion in 1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:50,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-20 10:54:50,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:50,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:50,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5ba91245a63450a80c83b9313e1f459 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ffpcajd8jc41r86rsm22an7u96242vb71a7aiioh76og0b7v18n96vvlt7qif6ff/family1/d5ba91245a63450a80c83b9313e1f459 2023-03-20 10:54:50,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ffpcajd8jc41r86rsm22an7u96242vb71a7aiioh76og0b7v18n96vvlt7qif6ff/family1/d5ba91245a63450a80c83b9313e1f459 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_ 2023-03-20 10:54:50,479 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ffpcajd8jc41r86rsm22an7u96242vb71a7aiioh76og0b7v18n96vvlt7qif6ff/family1/d5ba91245a63450a80c83b9313e1f459 into 1a39e1d017ce37e865c8dff1d0d345bf/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_ - updating store file list. 2023-03-20 10:54:50,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_ into 1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:50,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ffpcajd8jc41r86rsm22an7u96242vb71a7aiioh76og0b7v18n96vvlt7qif6ff/family1/d5ba91245a63450a80c83b9313e1f459 into 1a39e1d017ce37e865c8dff1d0d345bf/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_) 2023-03-20 10:54:50,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ffpcajd8jc41r86rsm22an7u96242vb71a7aiioh76og0b7v18n96vvlt7qif6ff/family1/d5ba91245a63450a80c83b9313e1f459 2023-03-20 10:54:50,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:54:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:54:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): 1a39e1d017ce37e865c8dff1d0d345bf/family1 is initiating minor compaction 2023-03-20 10:54:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@24cc667a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:50,487 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1a39e1d017ce37e865c8dff1d0d345bf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:50,487 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/091111422a6f498db0238947b3754b3c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/a005b86e6a984038b6782dfc9c7993c9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/d6d73dbf13ad489faa83ab77a006c35c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/dc2e4c8301174baa8f3ff0f6485eee12, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/ddc52f102ad2478e990265ff5a8f3bee, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/fb0079f757924200bca09aa8d8045822, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/f1da339612bc4c768daff5a14e73a21b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/b2cd2bfc8cce43398eb469a8f69a0032, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/20583304903d4ce7a295d96e0626892e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp, totalSize=50.4 K 2023-03-20 10:54:50,487 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 091111422a6f498db0238947b3754b3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:54:50,487 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting a005b86e6a984038b6782dfc9c7993c9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting d6d73dbf13ad489faa83ab77a006c35c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting dc2e4c8301174baa8f3ff0f6485eee12, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ddc52f102ad2478e990265ff5a8f3bee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting fb0079f757924200bca09aa8d8045822, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting f1da339612bc4c768daff5a14e73a21b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting b2cd2bfc8cce43398eb469a8f69a0032, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 20583304903d4ce7a295d96e0626892e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:54:50,488 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:54:50,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:50,490 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:50,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228782c540916994fed8dcb302fb82c4a02 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228782c540916994fed8dcb302fb82c4a02 2023-03-20 10:54:50,492 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123148f718ba09f341d391edd2802b898cab to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123148f718ba09f341d391edd2802b898cab 2023-03-20 10:54:50,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012e66d7eb775847afa8b2872f767dc33f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012e66d7eb775847afa8b2872f767dc33f 2023-03-20 10:54:50,494 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e636d50722094956bc1911b6416d73ac to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e636d50722094956bc1911b6416d73ac 2023-03-20 10:54:50,494 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-20 10:54:50,494 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:50,524 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1a39e1d017ce37e865c8dff1d0d345bf#family1#compaction#61 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:50,953 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/81449c487d9a4d09a85a9cdfa4d37841 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/81449c487d9a4d09a85a9cdfa4d37841 2023-03-20 10:54:50,958 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1a39e1d017ce37e865c8dff1d0d345bf/family1 of 1a39e1d017ce37e865c8dff1d0d345bf into 81449c487d9a4d09a85a9cdfa4d37841(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:50,958 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:50,958 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679309690487; duration=0sec 2023-03-20 10:54:50,959 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:51,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/091111422a6f498db0238947b3754b3c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/a005b86e6a984038b6782dfc9c7993c9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/d6d73dbf13ad489faa83ab77a006c35c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/dc2e4c8301174baa8f3ff0f6485eee12, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/ddc52f102ad2478e990265ff5a8f3bee, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/fb0079f757924200bca09aa8d8045822, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/f1da339612bc4c768daff5a14e73a21b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/b2cd2bfc8cce43398eb469a8f69a0032, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/20583304903d4ce7a295d96e0626892e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_] to archive 2023-03-20 10:54:51,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:51,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/091111422a6f498db0238947b3754b3c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/091111422a6f498db0238947b3754b3c 2023-03-20 10:54:51,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/a005b86e6a984038b6782dfc9c7993c9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/a005b86e6a984038b6782dfc9c7993c9 2023-03-20 10:54:51,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/d6d73dbf13ad489faa83ab77a006c35c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/d6d73dbf13ad489faa83ab77a006c35c 2023-03-20 10:54:51,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/dc2e4c8301174baa8f3ff0f6485eee12 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/dc2e4c8301174baa8f3ff0f6485eee12 2023-03-20 10:54:51,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/ddc52f102ad2478e990265ff5a8f3bee to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/ddc52f102ad2478e990265ff5a8f3bee 2023-03-20 10:54:51,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/fb0079f757924200bca09aa8d8045822 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/fb0079f757924200bca09aa8d8045822 2023-03-20 10:54:51,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/f1da339612bc4c768daff5a14e73a21b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/f1da339612bc4c768daff5a14e73a21b 2023-03-20 10:54:51,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/b2cd2bfc8cce43398eb469a8f69a0032 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/b2cd2bfc8cce43398eb469a8f69a0032 2023-03-20 10:54:51,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/20583304903d4ce7a295d96e0626892e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/20583304903d4ce7a295d96e0626892e 2023-03-20 10:54:51,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/055c4f7ede5b4ccb8d13581ac3c07720_SeqId_44_ 2023-03-20 10:54:51,367 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fff2b22f3b684871b398c3e9f4fbf2d3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fff2b22f3b684871b398c3e9f4fbf2d3 2023-03-20 10:54:51,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:51,395 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d8940d2cbb294dd19aef1acee3894ab7 first=Optional[r00] last=Optional[r2] 2023-03-20 10:54:51,395 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d8940d2cbb294dd19aef1acee3894ab7}] 2023-03-20 10:54:51,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d8940d2cbb294dd19aef1acee3894ab7 for inclusion in 1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:51,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-20 10:54:51,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:51,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:51,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d8940d2cbb294dd19aef1acee3894ab7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4qd4vqg77lsmop6ifge5mvis4dh8of46k5aiqh2n2kpe30v9j9hlkn4sbq837l4/family1/d8940d2cbb294dd19aef1acee3894ab7 2023-03-20 10:54:51,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4qd4vqg77lsmop6ifge5mvis4dh8of46k5aiqh2n2kpe30v9j9hlkn4sbq837l4/family1/d8940d2cbb294dd19aef1acee3894ab7 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_ 2023-03-20 10:54:51,404 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4qd4vqg77lsmop6ifge5mvis4dh8of46k5aiqh2n2kpe30v9j9hlkn4sbq837l4/family1/d8940d2cbb294dd19aef1acee3894ab7 into 1a39e1d017ce37e865c8dff1d0d345bf/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_ - updating store file list. 2023-03-20 10:54:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_ into 1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4qd4vqg77lsmop6ifge5mvis4dh8of46k5aiqh2n2kpe30v9j9hlkn4sbq837l4/family1/d8940d2cbb294dd19aef1acee3894ab7 into 1a39e1d017ce37e865c8dff1d0d345bf/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_) 2023-03-20 10:54:51,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4qd4vqg77lsmop6ifge5mvis4dh8of46k5aiqh2n2kpe30v9j9hlkn4sbq837l4/family1/d8940d2cbb294dd19aef1acee3894ab7 2023-03-20 10:54:51,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:54:51,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:54:51,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): 1a39e1d017ce37e865c8dff1d0d345bf/family1 is initiating minor compaction (all files) 2023-03-20 10:54:51,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@59ffe29d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:51,412 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1a39e1d017ce37e865c8dff1d0d345bf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:51,412 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/e5e66072afcd4696a2887412244e47b0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/81449c487d9a4d09a85a9cdfa4d37841, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp, totalSize=390.1 K 2023-03-20 10:54:51,412 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting e5e66072afcd4696a2887412244e47b0, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:54:51,413 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 81449c487d9a4d09a85a9cdfa4d37841, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:54:51,413 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 2c0969876c0844d09b850dbd66c4719b_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878847712 2023-03-20 10:54:51,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:51,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:51,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130b23ce2f4f8d34c6c8f1b3723eabfdd34 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130b23ce2f4f8d34c6c8f1b3723eabfdd34 2023-03-20 10:54:51,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201bba0f6f1b3b94a0c900f0c3ebeb84f81 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201bba0f6f1b3b94a0c900f0c3ebeb84f81 2023-03-20 10:54:51,423 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2dbf6b2875c4202832a8466e9e0db40 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2dbf6b2875c4202832a8466e9e0db40 2023-03-20 10:54:51,423 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-20 10:54:51,423 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-20 10:54:51,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:51,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:51,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:51,425 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:51,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8480 sec 2023-03-20 10:54:51,435 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1a39e1d017ce37e865c8dff1d0d345bf#family1#compaction#62 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:54:51,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-20 10:54:51,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:51,931 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-20 10:54:51,932 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-20 10:54:51,932 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-20 10:54:51,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-20 10:54:51,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE}] 2023-03-20 10:54:51,937 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE 2023-03-20 10:54:51,937 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:51,937 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309691937"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309691937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309691937"}]},"ts":"1679309691937"} 2023-03-20 10:54:51,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:52,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1a39e1d017ce37e865c8dff1d0d345bf, disabling compactions & flushes 2023-03-20 10:54:52,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,265 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/.tmp/family1/25833e87b2464c8a9a71101fc91b3242 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/25833e87b2464c8a9a71101fc91b3242 2023-03-20 10:54:52,293 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1a39e1d017ce37e865c8dff1d0d345bf/family1 of 1a39e1d017ce37e865c8dff1d0d345bf into 25833e87b2464c8a9a71101fc91b3242(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:54:52,293 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:52,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. after waiting 0 ms 2023-03-20 10:54:52,293 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1679309691411; duration=0sec 2023-03-20 10:54:52,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,293 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:54:52,295 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/e5e66072afcd4696a2887412244e47b0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/81449c487d9a4d09a85a9cdfa4d37841, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_] to archive 2023-03-20 10:54:52,296 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:52,298 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/e5e66072afcd4696a2887412244e47b0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/e5e66072afcd4696a2887412244e47b0 2023-03-20 10:54:52,300 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/81449c487d9a4d09a85a9cdfa4d37841 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/81449c487d9a4d09a85a9cdfa4d37841 2023-03-20 10:54:52,301 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/2c0969876c0844d09b850dbd66c4719b_SeqId_47_ 2023-03-20 10:54:52,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-20 10:54:52,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:52,311 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1a39e1d017ce37e865c8dff1d0d345bf to self. 2023-03-20 10:54:52,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,313 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=CLOSED 2023-03-20 10:54:52,313 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309692313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309692313"}]},"ts":"1679309692313"} 2023-03-20 10:54:52,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-20 10:54:52,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230 in 376 msec 2023-03-20 10:54:52,316 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=true 2023-03-20 10:54:52,467 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:52,467 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309692467"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309692467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309692467"}]},"ts":"1679309692467"} 2023-03-20 10:54:52,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:52,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a39e1d017ce37e865c8dff1d0d345bf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:52,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:52,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,627 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,628 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:52,628 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:52,629 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a39e1d017ce37e865c8dff1d0d345bf columnFamilyName family1 2023-03-20 10:54:52,634 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/25833e87b2464c8a9a71101fc91b3242 2023-03-20 10:54:52,635 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(310): Store=1a39e1d017ce37e865c8dff1d0d345bf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:52,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:52,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1a39e1d017ce37e865c8dff1d0d345bf; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74908661, jitterRate=0.11622603237628937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:52,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:52,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., pid=47, masterSystemTime=1679309692622 2023-03-20 10:54:52,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:52,642 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:52,643 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309692642"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309692642"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309692642"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309692642"}]},"ts":"1679309692642"} 2023-03-20 10:54:52,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-20 10:54:52,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230 in 175 msec 2023-03-20 10:54:52,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-20 10:54:52,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE in 710 msec 2023-03-20 10:54:52,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-20 10:54:52,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 714 msec 2023-03-20 10:54:52,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1320 sec 2023-03-20 10:54:52,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-20 10:54:52,653 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(278): alter status finished 2023-03-20 10:54:52,654 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:52,655 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:52,656 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:52,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:52,657 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310292657 2023-03-20 10:54:52,658 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:54:52,659 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-20 10:54:52,659 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:52,659 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x2e9b6631 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:52,669 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74f5c419, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:52,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:52,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:52,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:52,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:52,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:53,511 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280ba1bc8ec4284751856a60e28daeadef to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280ba1bc8ec4284751856a60e28daeadef 2023-03-20 10:54:53,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:53,525 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:54:53,526 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38148, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:54:53,533 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:54:53,535 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:54:53,548 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/732d8a2d02804b2882094bc74be299c1 first=Optional[r05] last=Optional[r8] 2023-03-20 10:54:53,549 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/732d8a2d02804b2882094bc74be299c1}] 2023-03-20 10:54:53,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/732d8a2d02804b2882094bc74be299c1 for inclusion in 1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:53,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-20 10:54:53,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:54:53,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:53,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/732d8a2d02804b2882094bc74be299c1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fhftqth80u1gv4vrsufk7fsl72dh9gmdqn7o9kd8ojaidkjcqmotefcj7am1r9d7/family1/732d8a2d02804b2882094bc74be299c1 2023-03-20 10:54:53,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fhftqth80u1gv4vrsufk7fsl72dh9gmdqn7o9kd8ojaidkjcqmotefcj7am1r9d7/family1/732d8a2d02804b2882094bc74be299c1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/5e6daadf02df42b287a97ef677aa7384_SeqId_53_ 2023-03-20 10:54:53,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fhftqth80u1gv4vrsufk7fsl72dh9gmdqn7o9kd8ojaidkjcqmotefcj7am1r9d7/family1/732d8a2d02804b2882094bc74be299c1 into 1a39e1d017ce37e865c8dff1d0d345bf/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/5e6daadf02df42b287a97ef677aa7384_SeqId_53_ - updating store file list. 2023-03-20 10:54:53,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/5e6daadf02df42b287a97ef677aa7384_SeqId_53_ into 1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:53,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fhftqth80u1gv4vrsufk7fsl72dh9gmdqn7o9kd8ojaidkjcqmotefcj7am1r9d7/family1/732d8a2d02804b2882094bc74be299c1 into 1a39e1d017ce37e865c8dff1d0d345bf/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/5e6daadf02df42b287a97ef677aa7384_SeqId_53_) 2023-03-20 10:54:53,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fhftqth80u1gv4vrsufk7fsl72dh9gmdqn7o9kd8ojaidkjcqmotefcj7am1r9d7/family1/732d8a2d02804b2882094bc74be299c1 2023-03-20 10:54:53,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:53,572 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:54:53,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208fad25f6cf414acf9cca02aa93290ddc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208fad25f6cf414acf9cca02aa93290ddc 2023-03-20 10:54:53,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f67f9b22f10e4ee78d57c7c519638d21 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f67f9b22f10e4ee78d57c7c519638d21 2023-03-20 10:54:53,575 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-20 10:54:53,575 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-20 10:54:53,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:53,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:53,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:53,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:53,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:53,576 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:53,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 921 msec 2023-03-20 10:54:53,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-20 10:54:53,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:54,169 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-20 10:54:54,171 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-20 10:54:54,172 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-20 10:54:54,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-20 10:54:54,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE}] 2023-03-20 10:54:54,181 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE 2023-03-20 10:54:54,182 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:54,182 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309694182"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309694182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309694182"}]},"ts":"1679309694182"} 2023-03-20 10:54:54,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:54,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1a39e1d017ce37e865c8dff1d0d345bf, disabling compactions & flushes 2023-03-20 10:54:54,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. after waiting 0 ms 2023-03-20 10:54:54,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-20 10:54:54,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:54,346 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1a39e1d017ce37e865c8dff1d0d345bf to self. 2023-03-20 10:54:54,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=CLOSED 2023-03-20 10:54:54,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309694348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309694348"}]},"ts":"1679309694348"} 2023-03-20 10:54:54,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-20 10:54:54,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230 in 164 msec 2023-03-20 10:54:54,351 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=true 2023-03-20 10:54:54,502 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:54,502 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309694502"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309694502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309694502"}]},"ts":"1679309694502"} 2023-03-20 10:54:54,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:54,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a39e1d017ce37e865c8dff1d0d345bf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:54,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:54,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,659 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,660 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:54,660 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1 2023-03-20 10:54:54,660 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a39e1d017ce37e865c8dff1d0d345bf columnFamilyName family1 2023-03-20 10:54:54,666 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/25833e87b2464c8a9a71101fc91b3242 2023-03-20 10:54:54,670 DEBUG [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/family1/5e6daadf02df42b287a97ef677aa7384_SeqId_53_ 2023-03-20 10:54:54,670 INFO [StoreOpener-1a39e1d017ce37e865c8dff1d0d345bf-1] regionserver.HStore(310): Store=1a39e1d017ce37e865c8dff1d0d345bf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:54,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:54:54,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1a39e1d017ce37e865c8dff1d0d345bf; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60362458, jitterRate=-0.10052928328514099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:54,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:54:54,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf., pid=53, masterSystemTime=1679309694654 2023-03-20 10:54:54,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:54:54,677 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1a39e1d017ce37e865c8dff1d0d345bf, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:54,677 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679309694677"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309694677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309694677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309694677"}]},"ts":"1679309694677"} 2023-03-20 10:54:54,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-20 10:54:54,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 1a39e1d017ce37e865c8dff1d0d345bf, server=jenkins-hbase20.apache.org,44189,1679309623230 in 175 msec 2023-03-20 10:54:54,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-20 10:54:54,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1a39e1d017ce37e865c8dff1d0d345bf, REOPEN/MOVE in 499 msec 2023-03-20 10:54:54,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-20 10:54:54,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 506 msec 2023-03-20 10:54:54,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 965 msec 2023-03-20 10:54:54,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-20 10:54:54,686 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(278): alter status finished 2023-03-20 10:54:54,687 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-20 10:54:54,688 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:54,689 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:54,690 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310294689 2023-03-20 10:54:54,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:54,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:54:54,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-20 10:54:54,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:54,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x19dfec4b to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:54:54,696 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d02665, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-20 10:54:54,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-20 10:54:54,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:54:54,699 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-20 10:54:54,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-03-20 10:54:54,767 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=244 (was 254), OpenFileDescriptor=608 (was 621), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 467), ProcessCount=187 (was 187), AvailableMemoryMB=9027 (was 9066) 2023-03-20 10:54:54,782 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=187, AvailableMemoryMB=9026 2023-03-20 10:54:54,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-20 10:54:54,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:54,787 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:54:54,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-20 10:54:54,788 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:54:54,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-20 10:54:54,790 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:54,790 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec empty. 2023-03-20 10:54:54,791 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:54,791 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-20 10:54:54,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-20 10:54:55,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-20 10:54:55,199 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-20 10:54:55,201 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 75a8b4d7351e02dabf5bd0e1f8bbe1ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:54:55,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-20 10:54:55,606 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:55,606 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 75a8b4d7351e02dabf5bd0e1f8bbe1ec, disabling compactions & flushes 2023-03-20 10:54:55,606 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,606 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,606 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. after waiting 0 ms 2023-03-20 10:54:55,606 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,606 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,606 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:55,608 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:54:55,609 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309695609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309695609"}]},"ts":"1679309695609"} 2023-03-20 10:54:55,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:54:55,611 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:54:55,611 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309695611"}]},"ts":"1679309695611"} 2023-03-20 10:54:55,612 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-20 10:54:55,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, ASSIGN}] 2023-03-20 10:54:55,615 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, ASSIGN 2023-03-20 10:54:55,616 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:54:55,767 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:55,767 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309695767"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309695767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309695767"}]},"ts":"1679309695767"} 2023-03-20 10:54:55,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:54:55,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-20 10:54:55,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75a8b4d7351e02dabf5bd0e1f8bbe1ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:54:55,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:54:55,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,931 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,933 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:54:55,933 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:54:55,934 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75a8b4d7351e02dabf5bd0e1f8bbe1ec columnFamilyName family1 2023-03-20 10:54:55,943 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(310): Store=75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:54:55,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:54:55,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:54:55,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 75a8b4d7351e02dabf5bd0e1f8bbe1ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73860297, jitterRate=0.10060419142246246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:54:55,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:55,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., pid=57, masterSystemTime=1679309695920 2023-03-20 10:54:55,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:55,956 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:55,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309695956"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309695956"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309695956"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309695956"}]},"ts":"1679309695956"} 2023-03-20 10:54:55,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-20 10:54:55,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230 in 191 msec 2023-03-20 10:54:55,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-20 10:54:55,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, ASSIGN in 347 msec 2023-03-20 10:54:55,966 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:54:55,966 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309695966"}]},"ts":"1679309695966"} 2023-03-20 10:54:55,971 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-20 10:54:55,972 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:54:55,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1880 sec 2023-03-20 10:54:56,750 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-20 10:54:56,897 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-20 10:54:56,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:56,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,935 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:56,935 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:56,935 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:54:56,935 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:54:56,938 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,938 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,939 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:56,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:56,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:56,939 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:56,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,939 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:56,940 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:56,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:56,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:56,946 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:54:56,946 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:56,946 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:54:56,947 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:56,947 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:56,947 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:56,947 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:54:56,956 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:54:57,391 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304ce6afc00b844743ac869bd519f6c3fc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511304ce6afc00b844743ac869bd519f6c3fc 2023-03-20 10:54:57,798 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/17d59cde05a24196b96ea58133ce54d2 2023-03-20 10:54:57,804 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/17d59cde05a24196b96ea58133ce54d2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/17d59cde05a24196b96ea58133ce54d2 2023-03-20 10:54:57,809 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/17d59cde05a24196b96ea58133ce54d2, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-20 10:54:57,812 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:54:57,817 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 861ms, sequenceid=5, compaction requested=false 2023-03-20 10:54:57,818 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:57,818 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:57,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:57,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:57,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:54:57,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:54:57,819 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:57,820 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,820 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,820 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:57,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:54:57,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@472f9991[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:57,821 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:54:57,821 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,822 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,822 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:54:57,822 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:54:57,822 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:57,822 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,822 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:54:57,823 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,823 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:54:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:57,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:54:57,825 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:54:57,825 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:57,825 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:57,825 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,825 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:57,826 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,826 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:57,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,826 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:57,827 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,828 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:57,831 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:57,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-20 10:54:57,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:57,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:57,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:57,831 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:57,832 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:57,832 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:57,932 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:57,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:57,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:57,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:57,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,942 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:57,942 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:57,942 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:54:57,942 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:54:57,943 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,943 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,944 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,944 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:57,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:57,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:57,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,944 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:57,944 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:57,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:54:57,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:57,946 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:54:57,946 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:57,946 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:54:57,950 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:57,950 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:57,950 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:57,950 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:54:57,950 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:54:58,370 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c8e15d2c8b1f4d46bd2137d71e6ccb84 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c8e15d2c8b1f4d46bd2137d71e6ccb84 2023-03-20 10:54:58,390 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/7860452dc5fe4efc8dceb2b21a36c0c0 2023-03-20 10:54:58,401 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/7860452dc5fe4efc8dceb2b21a36c0c0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/7860452dc5fe4efc8dceb2b21a36c0c0 2023-03-20 10:54:58,411 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/7860452dc5fe4efc8dceb2b21a36c0c0, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:54:58,412 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 462ms, sequenceid=9, compaction requested=false 2023-03-20 10:54:58,412 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:58,412 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:58,412 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:58,412 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:58,412 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,412 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:54:58,412 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:54:58,414 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:58,414 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:58,414 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,414 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:58,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:58,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:54:58,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54ad4b1c[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:58,417 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:54:58,417 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,419 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,420 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:54:58,420 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:54:58,420 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:58,420 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,420 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:58,421 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,421 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:54:58,421 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:58,421 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:54:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:58,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:58,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:58,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:58,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:54:58,429 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:54:58,429 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:58,429 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:58,429 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,429 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:58,433 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,433 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:58,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,433 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,434 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,435 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:58,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:58,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:58,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:58,441 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:58,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:58,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:58,441 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,442 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,442 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,442 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,442 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,442 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:58,442 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:58,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:58,542 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:58,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:58,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:58,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:58,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,554 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:58,554 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:58,554 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:54:58,554 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:54:58,556 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,556 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,557 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:58,557 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:58,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:58,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,558 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:58,558 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:58,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:54:58,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:58,559 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:54:58,559 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:58,559 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:54:58,562 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:58,562 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:58,562 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:58,562 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:54:58,562 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:58,982 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201196deee4d0f74a72894a89c62d096578 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201196deee4d0f74a72894a89c62d096578 2023-03-20 10:54:58,989 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/ff90e34f80144428940d64066ee23ab0 2023-03-20 10:54:58,995 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/ff90e34f80144428940d64066ee23ab0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ff90e34f80144428940d64066ee23ab0 2023-03-20 10:54:59,001 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ff90e34f80144428940d64066ee23ab0, entries=1, sequenceid=13, filesize=5.0 K 2023-03-20 10:54:59,002 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 440ms, sequenceid=13, compaction requested=true 2023-03-20 10:54:59,002 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:59,002 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:59,002 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:59,002 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:59,002 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,002 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:54:59,002 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:54:59,003 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,003 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,004 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,004 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:54:59,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b54d5ff[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:59,005 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:54:59,005 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,006 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,006 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:54:59,006 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,006 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:59,006 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:54:59,006 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:59,007 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:54:59,007 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,007 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,007 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:54:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:59,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:54:59,010 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:54:59,010 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:59,010 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:59,010 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,010 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:59,012 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,012 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,012 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:59,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,012 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,015 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,018 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,018 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,018 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,018 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:59,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-20 10:54:59,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:59,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:59,018 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,019 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,019 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:59,020 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:59,019 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:59,020 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:59,020 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:59,020 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:59,120 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:59,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:59,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:59,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:59,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,130 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:59,130 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:59,130 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:54:59,130 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:54:59,131 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,131 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,132 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,132 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:59,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,138 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,138 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:59,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,139 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:54:59,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:54:59,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:59,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:54:59,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:59,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:59,140 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:59,140 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:54:59,140 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:59,193 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b14e247500bf42109de5a2447c03d389 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b14e247500bf42109de5a2447c03d389 2023-03-20 10:54:59,221 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/c049148255104a2b95102e679668b356 2023-03-20 10:54:59,232 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/c049148255104a2b95102e679668b356 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c049148255104a2b95102e679668b356 2023-03-20 10:54:59,240 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c049148255104a2b95102e679668b356, entries=1, sequenceid=17, filesize=5.0 K 2023-03-20 10:54:59,242 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 102ms, sequenceid=17, compaction requested=true 2023-03-20 10:54:59,242 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:59,242 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:59,242 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:59,242 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:59,242 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,242 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:54:59,242 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:54:59,247 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,247 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,248 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,248 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:54:59,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c06eb82[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:59,249 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:54:59,249 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,251 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,251 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,251 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:59,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:54:59,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:54:59,251 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:59,253 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:54:59,253 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:59,253 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:54:59,257 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:59,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:54:59,262 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:54:59,262 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:59,262 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:59,262 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,262 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:59,267 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,267 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:59,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,270 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,273 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,274 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:59,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:59,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,279 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,279 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,279 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:59,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:59,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:59,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:59,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:59,279 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,280 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:59,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:59,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:59,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-20 10:54:59,380 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:59,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:59,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,394 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:59,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:59,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:54:59,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:54:59,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,396 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:59,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:59,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:59,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,396 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,396 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:59,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:59,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,397 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:54:59,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,398 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:54:59,398 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:59,398 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:54:59,402 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:59,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:59,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:54:59,402 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:59,403 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:54:59,425 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122800e564c9c10b4073ae3c7a183d3cd683 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122800e564c9c10b4073ae3c7a183d3cd683 2023-03-20 10:54:59,833 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/3c94d01c10fc48a7b17c6967423b75eb 2023-03-20 10:54:59,842 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/3c94d01c10fc48a7b17c6967423b75eb as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3c94d01c10fc48a7b17c6967423b75eb 2023-03-20 10:54:59,848 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3c94d01c10fc48a7b17c6967423b75eb, entries=1, sequenceid=21, filesize=5.0 K 2023-03-20 10:54:59,849 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 446ms, sequenceid=21, compaction requested=true 2023-03-20 10:54:59,849 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:54:59,849 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:59,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:54:59,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:54:59,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:54:59,849 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:54:59,851 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,851 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,851 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,851 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:54:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:54:59,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17de1c82[Count = 0] remaining members to acquire global barrier 2023-03-20 10:54:59,853 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:54:59,853 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,854 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,854 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:54:59,854 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:54:59,854 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:54:59,855 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,855 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:54:59,856 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:54:59,856 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:59,856 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,856 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:54:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:54:59,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:54:59,859 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:54:59,859 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:54:59,859 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:54:59,859 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,859 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:54:59,861 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,861 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:54:59,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,861 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:59,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:59,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:54:59,864 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:54:59,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,866 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:54:59,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:59,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-20 10:54:59,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:59,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,877 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:59,877 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:54:59,878 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:54:59,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:54:59,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:54:59,978 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:54:59,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:54:59,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:54:59,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:54:59,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,987 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:54:59,987 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:59,988 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:54:59,988 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:54:59,988 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,989 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,990 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,990 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:54:59,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:54:59,990 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:54:59,990 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:54:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:54:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:54:59,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:54:59,994 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:54:59,994 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:54:59,994 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:54:59,995 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:54:59,995 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:54:59,995 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:54:59,995 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:54:59,995 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:55:00,412 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c5886bc7a3a04057a118fa30a16a9af9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c5886bc7a3a04057a118fa30a16a9af9 2023-03-20 10:55:00,427 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/244637dcb94440738b484d0db5e54d97 2023-03-20 10:55:00,445 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/244637dcb94440738b484d0db5e54d97 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/244637dcb94440738b484d0db5e54d97 2023-03-20 10:55:00,451 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/244637dcb94440738b484d0db5e54d97, entries=1, sequenceid=25, filesize=5.0 K 2023-03-20 10:55:00,452 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 457ms, sequenceid=25, compaction requested=true 2023-03-20 10:55:00,452 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:00,452 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:00,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:00,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:00,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:55:00,452 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:55:00,455 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,455 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:00,455 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,455 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:00,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:55:00,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@299540ce[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:00,457 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:55:00,457 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,457 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,457 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:55:00,457 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:55:00,458 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:00,458 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,458 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:00,458 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:55:00,458 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:00,458 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:00,459 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:55:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:00,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:00,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:55:00,470 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:55:00,470 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:00,470 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:00,470 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,470 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:00,476 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,476 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,476 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:00,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:00,478 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,480 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,483 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:00,483 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,483 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:00,483 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:00,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:00,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:00,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:00,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:00,483 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:00,484 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:00,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:00,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:00,584 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:00,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:00,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,591 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:00,591 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:00,591 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:55:00,591 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:55:00,592 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,592 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,593 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,593 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:00,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:00,593 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:00,593 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,594 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:55:00,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:00,594 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:55:00,594 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:00,594 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:55:00,595 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:00,595 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:00,595 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:00,595 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:55:00,595 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:55:01,015 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101aa9204cecb73436eb631ebff968f2a3b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101aa9204cecb73436eb631ebff968f2a3b 2023-03-20 10:55:01,422 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/80f928f3ab774e2288d4afde97209a69 2023-03-20 10:55:01,427 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/80f928f3ab774e2288d4afde97209a69 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/80f928f3ab774e2288d4afde97209a69 2023-03-20 10:55:01,432 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/80f928f3ab774e2288d4afde97209a69, entries=1, sequenceid=29, filesize=5.0 K 2023-03-20 10:55:01,433 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 838ms, sequenceid=29, compaction requested=true 2023-03-20 10:55:01,433 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:01,433 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:55:01,433 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:55:01,434 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,434 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:01,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:55:01,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3473832e[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:01,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:55:01,437 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,438 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,438 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:55:01,438 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:55:01,438 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:01,438 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,438 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:01,439 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,439 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:55:01,440 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:01,440 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:55:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:01,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:01,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:55:01,443 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:55:01,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:01,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:01,443 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,443 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:01,444 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,444 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:01,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,444 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:01,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:01,445 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,446 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:01,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:01,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,448 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:01,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:01,448 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:01,449 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:01,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:01,549 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:01,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:01,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:01,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:01,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,560 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:01,560 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:01,560 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:55:01,560 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:55:01,561 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,561 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,562 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:01,562 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:01,562 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:01,562 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,563 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:55:01,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:55:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:55:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:01,563 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:01,563 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:55:01,564 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:55:01,980 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103440ff065434b4a4daae698676beb4e11 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103440ff065434b4a4daae698676beb4e11 2023-03-20 10:55:02,389 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/c4ac2039ae7241bb8ab1571abb058a86 2023-03-20 10:55:02,401 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/c4ac2039ae7241bb8ab1571abb058a86 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c4ac2039ae7241bb8ab1571abb058a86 2023-03-20 10:55:02,409 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c4ac2039ae7241bb8ab1571abb058a86, entries=1, sequenceid=33, filesize=5.0 K 2023-03-20 10:55:02,410 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 846ms, sequenceid=33, compaction requested=true 2023-03-20 10:55:02,410 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:02,410 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:02,410 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:02,410 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:02,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:55:02,411 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:55:02,412 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,412 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:02,413 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,413 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:02,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:55:02,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f3234d9[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:02,415 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:55:02,415 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,416 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,416 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:55:02,417 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:55:02,417 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:02,417 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,417 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:02,418 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:55:02,418 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,418 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:02,418 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:55:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:02,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:02,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:02,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:02,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:55:02,423 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:55:02,423 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:02,423 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:02,423 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,423 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:02,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,425 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:02,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:02,425 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,427 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:02,430 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:02,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:02,430 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:02,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:02,431 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:02,431 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:02,531 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:02,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:02,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:02,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:02,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,540 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:02,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:02,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:55:02,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:55:02,541 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,541 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,542 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:02,542 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:02,543 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:02,543 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:55:02,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:02,545 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:55:02,545 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:02,546 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:55:02,546 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:02,546 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:02,546 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:02,546 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:55:02,546 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:55:02,964 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071b20c775e50548868622c215b6afa63e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509071b20c775e50548868622c215b6afa63e 2023-03-20 10:55:03,373 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/e7341035a03f4d8c8c3a35e601c5c9f6 2023-03-20 10:55:03,385 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/e7341035a03f4d8c8c3a35e601c5c9f6 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/e7341035a03f4d8c8c3a35e601c5c9f6 2023-03-20 10:55:03,390 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/e7341035a03f4d8c8c3a35e601c5c9f6, entries=1, sequenceid=37, filesize=5.0 K 2023-03-20 10:55:03,390 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 844ms, sequenceid=37, compaction requested=true 2023-03-20 10:55:03,390 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:03,390 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:03,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:03,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:03,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:55:03,391 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:55:03,392 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:03,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:03,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:55:03,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48ef17b1[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:03,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:55:03,394 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,394 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,395 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:55:03,395 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:55:03,395 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:03,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:03,396 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:55:03,396 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:03,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,396 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:55:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:03,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:55:03,398 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:55:03,398 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:03,398 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:03,398 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,398 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:03,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:03,399 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:03,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:03,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:03,399 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,400 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,401 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,401 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,401 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,401 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:03,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:03,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:03,401 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:03,401 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:03,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:03,401 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:03,402 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:03,402 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:03,402 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:03,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:03,402 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,402 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,502 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:03,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:03,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:03,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:03,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,508 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:03,508 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:03,508 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-20 10:55:03,508 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-20 10:55:03,509 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,509 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,510 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:03,510 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:03,510 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:03,510 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,511 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,512 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-20 10:55:03,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:03,512 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-20 10:55:03,512 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:03,512 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-20 10:55:03,514 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:03,514 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:03,514 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:03,514 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. started... 2023-03-20 10:55:03,514 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 75a8b4d7351e02dabf5bd0e1f8bbe1ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:55:03,929 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e3943db0f40e4b2280880925c650f0ed to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e3943db0f40e4b2280880925c650f0ed 2023-03-20 10:55:04,339 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/ae03321a9c2c4c8088d3241fac97247b 2023-03-20 10:55:04,346 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/ae03321a9c2c4c8088d3241fac97247b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ae03321a9c2c4c8088d3241fac97247b 2023-03-20 10:55:04,350 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ae03321a9c2c4c8088d3241fac97247b, entries=1, sequenceid=41, filesize=5.0 K 2023-03-20 10:55:04,351 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 75a8b4d7351e02dabf5bd0e1f8bbe1ec in 837ms, sequenceid=41, compaction requested=true 2023-03-20 10:55:04,351 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:04,351 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:04,351 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:04,351 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:04,351 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,351 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-20 10:55:04,351 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-20 10:55:04,352 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:04,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,353 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:04,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-20 10:55:04,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7fbd52[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:04,354 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-20 10:55:04,354 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,354 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-20 10:55:04,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-20 10:55:04,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:04,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,355 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:04,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-20 10:55:04,355 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,355 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:04,356 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:04,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-20 10:55:04,357 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-20 10:55:04,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:04,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:04,357 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,357 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:04,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:04,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,358 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:04,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:04,359 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,359 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,361 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-20 10:55:04,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:04,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:04,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:04,361 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:04,461 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:04,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:04,464 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:04,465 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:04,466 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:04,467 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310304467 2023-03-20 10:55:04,467 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:04,468 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:55:04,469 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-20 10:55:04,469 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:04,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x632c8c46 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:04,480 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73cd7de5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:04,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,529 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103be31a2de90ed471e8fbaf51beb7f492e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103be31a2de90ed471e8fbaf51beb7f492e 2023-03-20 10:55:04,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:04,546 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:04,547 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:04,566 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:55:04,567 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:55:04,585 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/226ce4f32c5e4e28bad179bdbdd67c4a first=Optional[r3] last=Optional[r6] 2023-03-20 10:55:04,585 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/226ce4f32c5e4e28bad179bdbdd67c4a}] 2023-03-20 10:55:04,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/226ce4f32c5e4e28bad179bdbdd67c4a for inclusion in 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-20 10:55:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:55:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:04,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/226ce4f32c5e4e28bad179bdbdd67c4a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dj53e35qsjq1fc5h0ifntdp1ikncga77dqskrtqu46lti4fpmu0fk0dj80ap82s4/family1/226ce4f32c5e4e28bad179bdbdd67c4a 2023-03-20 10:55:04,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dj53e35qsjq1fc5h0ifntdp1ikncga77dqskrtqu46lti4fpmu0fk0dj80ap82s4/family1/226ce4f32c5e4e28bad179bdbdd67c4a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_ 2023-03-20 10:55:04,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dj53e35qsjq1fc5h0ifntdp1ikncga77dqskrtqu46lti4fpmu0fk0dj80ap82s4/family1/226ce4f32c5e4e28bad179bdbdd67c4a into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_ - updating store file list. 2023-03-20 10:55:04,608 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_ into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:04,608 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dj53e35qsjq1fc5h0ifntdp1ikncga77dqskrtqu46lti4fpmu0fk0dj80ap82s4/family1/226ce4f32c5e4e28bad179bdbdd67c4a into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_) 2023-03-20 10:55:04,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dj53e35qsjq1fc5h0ifntdp1ikncga77dqskrtqu46lti4fpmu0fk0dj80ap82s4/family1/226ce4f32c5e4e28bad179bdbdd67c4a 2023-03-20 10:55:04,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:55:04,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:55:04,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 is initiating minor compaction 2023-03-20 10:55:04,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19883299; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:04,616 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:04,617 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/7860452dc5fe4efc8dceb2b21a36c0c0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ff90e34f80144428940d64066ee23ab0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c049148255104a2b95102e679668b356, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3c94d01c10fc48a7b17c6967423b75eb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/244637dcb94440738b484d0db5e54d97, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/80f928f3ab774e2288d4afde97209a69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c4ac2039ae7241bb8ab1571abb058a86, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/e7341035a03f4d8c8c3a35e601c5c9f6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ae03321a9c2c4c8088d3241fac97247b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp, totalSize=50.3 K 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 7860452dc5fe4efc8dceb2b21a36c0c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ff90e34f80144428940d64066ee23ab0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting c049148255104a2b95102e679668b356, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 3c94d01c10fc48a7b17c6967423b75eb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 244637dcb94440738b484d0db5e54d97, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 80f928f3ab774e2288d4afde97209a69, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting c4ac2039ae7241bb8ab1571abb058a86, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting e7341035a03f4d8c8c3a35e601c5c9f6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ae03321a9c2c4c8088d3241fac97247b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:55:04,617 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:55:04,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:04,625 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:04,627 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122800e564c9c10b4073ae3c7a183d3cd683 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122800e564c9c10b4073ae3c7a183d3cd683 2023-03-20 10:55:04,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c5886bc7a3a04057a118fa30a16a9af9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c5886bc7a3a04057a118fa30a16a9af9 2023-03-20 10:55:04,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101aa9204cecb73436eb631ebff968f2a3b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101aa9204cecb73436eb631ebff968f2a3b 2023-03-20 10:55:04,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103440ff065434b4a4daae698676beb4e11 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103440ff065434b4a4daae698676beb4e11 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-20 10:55:04,635 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,636 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,636 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:04,767 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 75a8b4d7351e02dabf5bd0e1f8bbe1ec#family1#compaction#73 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:04,825 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/3f2d4e4762e544d8ac9c88570f2292c3 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3f2d4e4762e544d8ac9c88570f2292c3 2023-03-20 10:55:04,834 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 of 75a8b4d7351e02dabf5bd0e1f8bbe1ec into 3f2d4e4762e544d8ac9c88570f2292c3(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:04,835 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:04,835 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679309704616; duration=0sec 2023-03-20 10:55:04,835 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:04,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/7860452dc5fe4efc8dceb2b21a36c0c0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ff90e34f80144428940d64066ee23ab0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c049148255104a2b95102e679668b356, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3c94d01c10fc48a7b17c6967423b75eb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/244637dcb94440738b484d0db5e54d97, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/80f928f3ab774e2288d4afde97209a69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c4ac2039ae7241bb8ab1571abb058a86, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/e7341035a03f4d8c8c3a35e601c5c9f6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ae03321a9c2c4c8088d3241fac97247b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_] to archive 2023-03-20 10:55:04,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:04,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/7860452dc5fe4efc8dceb2b21a36c0c0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/7860452dc5fe4efc8dceb2b21a36c0c0 2023-03-20 10:55:04,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ff90e34f80144428940d64066ee23ab0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ff90e34f80144428940d64066ee23ab0 2023-03-20 10:55:04,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c049148255104a2b95102e679668b356 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c049148255104a2b95102e679668b356 2023-03-20 10:55:04,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3c94d01c10fc48a7b17c6967423b75eb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3c94d01c10fc48a7b17c6967423b75eb 2023-03-20 10:55:04,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/244637dcb94440738b484d0db5e54d97 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/244637dcb94440738b484d0db5e54d97 2023-03-20 10:55:04,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/80f928f3ab774e2288d4afde97209a69 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/80f928f3ab774e2288d4afde97209a69 2023-03-20 10:55:04,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c4ac2039ae7241bb8ab1571abb058a86 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/c4ac2039ae7241bb8ab1571abb058a86 2023-03-20 10:55:04,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/e7341035a03f4d8c8c3a35e601c5c9f6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/e7341035a03f4d8c8c3a35e601c5c9f6 2023-03-20 10:55:04,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ae03321a9c2c4c8088d3241fac97247b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/ae03321a9c2c4c8088d3241fac97247b 2023-03-20 10:55:04,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/72e1fe1a584e492994232e0f3f2a87f6_SeqId_44_ 2023-03-20 10:55:05,149 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205df4343a7240a4801a6ef5c5288d48db5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205df4343a7240a4801a6ef5c5288d48db5 2023-03-20 10:55:05,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:05,189 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fdb13e318c364f8687a3e91d43b4b7aa first=Optional[r00] last=Optional[r2] 2023-03-20 10:55:05,190 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fdb13e318c364f8687a3e91d43b4b7aa}] 2023-03-20 10:55:05,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fdb13e318c364f8687a3e91d43b4b7aa for inclusion in 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:05,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-20 10:55:05,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:55:05,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:05,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fdb13e318c364f8687a3e91d43b4b7aa to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sbgd7253f9b1k5um56poq1r08mnsdv25r854i5bmvo53ui5edqfpfdt357ibdsar/family1/fdb13e318c364f8687a3e91d43b4b7aa 2023-03-20 10:55:05,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sbgd7253f9b1k5um56poq1r08mnsdv25r854i5bmvo53ui5edqfpfdt357ibdsar/family1/fdb13e318c364f8687a3e91d43b4b7aa as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_ 2023-03-20 10:55:05,212 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sbgd7253f9b1k5um56poq1r08mnsdv25r854i5bmvo53ui5edqfpfdt357ibdsar/family1/fdb13e318c364f8687a3e91d43b4b7aa into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_ - updating store file list. 2023-03-20 10:55:05,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_ into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:05,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sbgd7253f9b1k5um56poq1r08mnsdv25r854i5bmvo53ui5edqfpfdt357ibdsar/family1/fdb13e318c364f8687a3e91d43b4b7aa into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_) 2023-03-20 10:55:05,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sbgd7253f9b1k5um56poq1r08mnsdv25r854i5bmvo53ui5edqfpfdt357ibdsar/family1/fdb13e318c364f8687a3e91d43b4b7aa 2023-03-20 10:55:05,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:55:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:55:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 is initiating minor compaction (all files) 2023-03-20 10:55:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@218e2c95; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:05,218 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:05,218 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/17d59cde05a24196b96ea58133ce54d2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3f2d4e4762e544d8ac9c88570f2292c3, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp, totalSize=388.1 K 2023-03-20 10:55:05,219 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 17d59cde05a24196b96ea58133ce54d2, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:55:05,219 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 3f2d4e4762e544d8ac9c88570f2292c3, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:55:05,219 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878847712 2023-03-20 10:55:05,221 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:05,221 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:05,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511304ce6afc00b844743ac869bd519f6c3fc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511304ce6afc00b844743ac869bd519f6c3fc 2023-03-20 10:55:05,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201196deee4d0f74a72894a89c62d096578 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201196deee4d0f74a72894a89c62d096578 2023-03-20 10:55:05,231 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b14e247500bf42109de5a2447c03d389 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b14e247500bf42109de5a2447c03d389 2023-03-20 10:55:05,231 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-20 10:55:05,231 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-20 10:55:05,232 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:05,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:05,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:05,235 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:05,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 771 msec 2023-03-20 10:55:05,248 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 75a8b4d7351e02dabf5bd0e1f8bbe1ec#family1#compaction#74 average throughput is 11.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:05,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-20 10:55:05,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:05,719 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-20 10:55:05,720 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-20 10:55:05,720 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-20 10:55:05,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-20 10:55:05,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE}] 2023-03-20 10:55:05,726 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE 2023-03-20 10:55:05,727 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:05,727 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309705727"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309705727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309705727"}]},"ts":"1679309705727"} 2023-03-20 10:55:05,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:05,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:05,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 75a8b4d7351e02dabf5bd0e1f8bbe1ec, disabling compactions & flushes 2023-03-20 10:55:05,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,477 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/.tmp/family1/696f2b1899474bc295b8169b90e33e98 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/696f2b1899474bc295b8169b90e33e98 2023-03-20 10:55:06,484 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 of 75a8b4d7351e02dabf5bd0e1f8bbe1ec into 696f2b1899474bc295b8169b90e33e98(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:06,484 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:06,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. after waiting 0 ms 2023-03-20 10:55:06,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,484 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1679309705218; duration=1sec 2023-03-20 10:55:06,484 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:06,488 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/17d59cde05a24196b96ea58133ce54d2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3f2d4e4762e544d8ac9c88570f2292c3, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_] to archive 2023-03-20 10:55:06,488 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:06,490 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/17d59cde05a24196b96ea58133ce54d2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/17d59cde05a24196b96ea58133ce54d2 2023-03-20 10:55:06,491 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3f2d4e4762e544d8ac9c88570f2292c3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/3f2d4e4762e544d8ac9c88570f2292c3 2023-03-20 10:55:06,492 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/f7766ac7411d4c5d9ca6603a63824c11_SeqId_47_ 2023-03-20 10:55:06,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-20 10:55:06,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:06,497 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 75a8b4d7351e02dabf5bd0e1f8bbe1ec to self. 2023-03-20 10:55:06,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,499 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=CLOSED 2023-03-20 10:55:06,499 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309706499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309706499"}]},"ts":"1679309706499"} 2023-03-20 10:55:06,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-20 10:55:06,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230 in 771 msec 2023-03-20 10:55:06,502 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=true 2023-03-20 10:55:06,652 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:06,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309706652"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309706652"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309706652"}]},"ts":"1679309706652"} 2023-03-20 10:55:06,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:06,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75a8b4d7351e02dabf5bd0e1f8bbe1ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:55:06,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:06,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,810 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,811 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:06,811 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:06,812 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75a8b4d7351e02dabf5bd0e1f8bbe1ec columnFamilyName family1 2023-03-20 10:55:06,817 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/696f2b1899474bc295b8169b90e33e98 2023-03-20 10:55:06,817 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(310): Store=75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:06,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:06,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 75a8b4d7351e02dabf5bd0e1f8bbe1ec; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69427996, jitterRate=0.0345577597618103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:55:06,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:06,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., pid=63, masterSystemTime=1679309706806 2023-03-20 10:55:06,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:06,825 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:06,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309706825"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309706825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309706825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309706825"}]},"ts":"1679309706825"} 2023-03-20 10:55:06,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-20 10:55:06,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230 in 172 msec 2023-03-20 10:55:06,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-20 10:55:06,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE in 1.1020 sec 2023-03-20 10:55:06,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-20 10:55:06,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1070 sec 2023-03-20 10:55:06,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5210 sec 2023-03-20 10:55:06,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-20 10:55:06,833 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(278): alter status finished 2023-03-20 10:55:06,834 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:06,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:06,836 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:06,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:06,837 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310306837 2023-03-20 10:55:06,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:55:06,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-20 10:55:06,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:06,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x4a696207 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:06,843 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28ab7568, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:07,666 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289383cabe845247bbb839c71c38d85d2d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511289383cabe845247bbb839c71c38d85d2d 2023-03-20 10:55:07,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:07,678 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:07,679 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:07,686 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:55:07,688 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34298, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:55:07,698 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26b4dea1960a4ff6a8504f53c14ec798 first=Optional[r05] last=Optional[r8] 2023-03-20 10:55:07,699 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26b4dea1960a4ff6a8504f53c14ec798}] 2023-03-20 10:55:07,703 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26b4dea1960a4ff6a8504f53c14ec798 for inclusion in 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:07,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-20 10:55:07,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:55:07,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:07,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26b4dea1960a4ff6a8504f53c14ec798 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kkencmqrjbbbjrjp7c1iolva1520v3hnmi34jjtkn9tj5qul4gbeun5gn56nl0f0/family1/26b4dea1960a4ff6a8504f53c14ec798 2023-03-20 10:55:07,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kkencmqrjbbbjrjp7c1iolva1520v3hnmi34jjtkn9tj5qul4gbeun5gn56nl0f0/family1/26b4dea1960a4ff6a8504f53c14ec798 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/4e3dfe05c02c423cb32d65b574b77ea2_SeqId_53_ 2023-03-20 10:55:07,709 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kkencmqrjbbbjrjp7c1iolva1520v3hnmi34jjtkn9tj5qul4gbeun5gn56nl0f0/family1/26b4dea1960a4ff6a8504f53c14ec798 into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/4e3dfe05c02c423cb32d65b574b77ea2_SeqId_53_ - updating store file list. 2023-03-20 10:55:07,712 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/4e3dfe05c02c423cb32d65b574b77ea2_SeqId_53_ into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:07,712 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kkencmqrjbbbjrjp7c1iolva1520v3hnmi34jjtkn9tj5qul4gbeun5gn56nl0f0/family1/26b4dea1960a4ff6a8504f53c14ec798 into 75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/4e3dfe05c02c423cb32d65b574b77ea2_SeqId_53_) 2023-03-20 10:55:07,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kkencmqrjbbbjrjp7c1iolva1520v3hnmi34jjtkn9tj5qul4gbeun5gn56nl0f0/family1/26b4dea1960a4ff6a8504f53c14ec798 2023-03-20 10:55:07,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:07,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:07,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e3943db0f40e4b2280880925c650f0ed to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e3943db0f40e4b2280880925c650f0ed 2023-03-20 10:55:07,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c8e15d2c8b1f4d46bd2137d71e6ccb84 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c8e15d2c8b1f4d46bd2137d71e6ccb84 2023-03-20 10:55:07,717 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-20 10:55:07,717 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-20 10:55:07,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:07,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:07,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:07,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:07,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:07,718 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:07,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 883 msec 2023-03-20 10:55:07,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-20 10:55:07,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:08,186 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-20 10:55:08,187 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-20 10:55:08,188 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-20 10:55:08,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-20 10:55:08,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE}] 2023-03-20 10:55:08,195 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE 2023-03-20 10:55:08,195 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:08,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309708195"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309708195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309708195"}]},"ts":"1679309708195"} 2023-03-20 10:55:08,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:08,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 75a8b4d7351e02dabf5bd0e1f8bbe1ec, disabling compactions & flushes 2023-03-20 10:55:08,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. after waiting 0 ms 2023-03-20 10:55:08,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-20 10:55:08,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:08,363 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 75a8b4d7351e02dabf5bd0e1f8bbe1ec to self. 2023-03-20 10:55:08,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,365 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=CLOSED 2023-03-20 10:55:08,365 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309708365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309708365"}]},"ts":"1679309708365"} 2023-03-20 10:55:08,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-20 10:55:08,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230 in 169 msec 2023-03-20 10:55:08,367 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=true 2023-03-20 10:55:08,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:08,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309708518"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309708518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309708518"}]},"ts":"1679309708518"} 2023-03-20 10:55:08,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:08,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75a8b4d7351e02dabf5bd0e1f8bbe1ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:55:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,680 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,681 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:08,681 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1 2023-03-20 10:55:08,681 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75a8b4d7351e02dabf5bd0e1f8bbe1ec columnFamilyName family1 2023-03-20 10:55:08,687 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/4e3dfe05c02c423cb32d65b574b77ea2_SeqId_53_ 2023-03-20 10:55:08,692 DEBUG [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1/696f2b1899474bc295b8169b90e33e98 2023-03-20 10:55:08,692 INFO [StoreOpener-75a8b4d7351e02dabf5bd0e1f8bbe1ec-1] regionserver.HStore(310): Store=75a8b4d7351e02dabf5bd0e1f8bbe1ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:08,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:55:08,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 75a8b4d7351e02dabf5bd0e1f8bbe1ec; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68666958, jitterRate=0.02321740984916687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:55:08,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:55:08,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec., pid=69, masterSystemTime=1679309708674 2023-03-20 10:55:08,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:55:08,702 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=75a8b4d7351e02dabf5bd0e1f8bbe1ec, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:08,702 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679309708702"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309708702"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309708702"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309708702"}]},"ts":"1679309708702"} 2023-03-20 10:55:08,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-20 10:55:08,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 75a8b4d7351e02dabf5bd0e1f8bbe1ec, server=jenkins-hbase20.apache.org,44189,1679309623230 in 182 msec 2023-03-20 10:55:08,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-20 10:55:08,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=75a8b4d7351e02dabf5bd0e1f8bbe1ec, REOPEN/MOVE in 510 msec 2023-03-20 10:55:08,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-20 10:55:08,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 515 msec 2023-03-20 10:55:08,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 937 msec 2023-03-20 10:55:08,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-20 10:55:08,710 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(278): alter status finished 2023-03-20 10:55:08,711 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-20 10:55:08,712 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:08,713 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:08,714 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:08,714 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310308714 2023-03-20 10:55:08,715 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:55:08,715 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-20 10:55:08,715 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:08,716 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x7e8d9f94 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:08,720 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19be6860, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-20 10:55:08,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-20 10:55:08,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:08,721 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-20 10:55:08,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-03-20 10:55:08,769 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=252 (was 244) - Thread LEAK? -, OpenFileDescriptor=638 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=366 (was 409), ProcessCount=187 (was 187), AvailableMemoryMB=8859 (was 9026) 2023-03-20 10:55:08,782 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=252, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=366, ProcessCount=187, AvailableMemoryMB=8859 2023-03-20 10:55:08,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-20 10:55:08,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:08,788 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:55:08,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-20 10:55:08,789 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:55:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-20 10:55:08,790 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:08,791 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 empty. 2023-03-20 10:55:08,791 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:08,792 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-20 10:55:08,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-20 10:55:09,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-20 10:55:09,200 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-20 10:55:09,201 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9a04d71c9b881a10f7def11e77c39298, NAME => 'testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:09,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-20 10:55:09,607 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:09,607 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 9a04d71c9b881a10f7def11e77c39298, disabling compactions & flushes 2023-03-20 10:55:09,607 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,607 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,607 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. after waiting 0 ms 2023-03-20 10:55:09,607 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,607 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,607 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:09,610 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:55:09,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679309709611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309709611"}]},"ts":"1679309709611"} 2023-03-20 10:55:09,612 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:55:09,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:55:09,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309709613"}]},"ts":"1679309709613"} 2023-03-20 10:55:09,614 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-20 10:55:09,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, ASSIGN}] 2023-03-20 10:55:09,619 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, ASSIGN 2023-03-20 10:55:09,620 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:09,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=9a04d71c9b881a10f7def11e77c39298, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:09,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679309709771"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309709771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309709771"}]},"ts":"1679309709771"} 2023-03-20 10:55:09,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 9a04d71c9b881a10f7def11e77c39298, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:09,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-20 10:55:09,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a04d71c9b881a10f7def11e77c39298, NAME => 'testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:55:09,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-20 10:55:09,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-20 10:55:09,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:09,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,933 INFO [StoreOpener-9a04d71c9b881a10f7def11e77c39298-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,934 DEBUG [StoreOpener-9a04d71c9b881a10f7def11e77c39298-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1 2023-03-20 10:55:09,934 DEBUG [StoreOpener-9a04d71c9b881a10f7def11e77c39298-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1 2023-03-20 10:55:09,934 INFO [StoreOpener-9a04d71c9b881a10f7def11e77c39298-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a04d71c9b881a10f7def11e77c39298 columnFamilyName f1 2023-03-20 10:55:09,936 INFO [StoreOpener-9a04d71c9b881a10f7def11e77c39298-1] regionserver.HStore(310): Store=9a04d71c9b881a10f7def11e77c39298/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:09,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:09,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:09,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9a04d71c9b881a10f7def11e77c39298; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62735293, jitterRate=-0.06517128646373749}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:55:09,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:09,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298., pid=73, masterSystemTime=1679309709926 2023-03-20 10:55:09,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:09,945 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=9a04d71c9b881a10f7def11e77c39298, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:09,945 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679309709945"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309709945"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309709945"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309709945"}]},"ts":"1679309709945"} 2023-03-20 10:55:09,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-20 10:55:09,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 9a04d71c9b881a10f7def11e77c39298, server=jenkins-hbase20.apache.org,44189,1679309623230 in 174 msec 2023-03-20 10:55:09,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-20 10:55:09,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, ASSIGN in 331 msec 2023-03-20 10:55:09,951 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:55:09,951 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309709951"}]},"ts":"1679309709951"} 2023-03-20 10:55:09,952 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-20 10:55:09,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:55:09,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1810 sec 2023-03-20 10:55:10,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-20 10:55:10,896 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-20 10:55:10,897 DEBUG [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-20 10:55:10,899 INFO [Listener at localhost.localdomain/43657] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-20 10:55:10,902 INFO [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-20 10:55:10,903 INFO [Listener at localhost.localdomain/43657] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-20 10:55:10,903 INFO [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-20 10:55:10,907 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2745): Flushing 9a04d71c9b881a10f7def11e77c39298 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-20 10:55:11,320 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303206cb0a0b2b7464261bd2ab926ff166b5b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303206cb0a0b2b7464261bd2ab926ff166b5b 2023-03-20 10:55:11,725 INFO [Listener at localhost.localdomain/43657] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/.tmp/f1/44a82e546bbe4278b0f652c4ace7b1db 2023-03-20 10:55:11,730 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/.tmp/f1/44a82e546bbe4278b0f652c4ace7b1db as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db 2023-03-20 10:55:11,734 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db, entries=1, sequenceid=5, filesize=4.9 K 2023-03-20 10:55:11,735 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 9a04d71c9b881a10f7def11e77c39298 in 828ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:11,736 DEBUG [Listener at localhost.localdomain/43657] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-20 10:55:11,736 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2446): Flush status journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:11,738 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2745): Flushing 9a04d71c9b881a10f7def11e77c39298 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-20 10:55:11,754 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032006697065bb004bb9acc0f1099594db35 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023032006697065bb004bb9acc0f1099594db35 2023-03-20 10:55:12,030 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:55:12,086 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-20 10:55:12,086 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-03-20 10:55:12,161 INFO [Listener at localhost.localdomain/43657] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/.tmp/f1/6e7a03ecbf2149c9b3b05872cae4b9ec 2023-03-20 10:55:12,165 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/.tmp/f1/6e7a03ecbf2149c9b3b05872cae4b9ec as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec 2023-03-20 10:55:12,170 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec, entries=1, sequenceid=9, filesize=4.9 K 2023-03-20 10:55:12,171 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 9a04d71c9b881a10f7def11e77c39298 in 433ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:12,171 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2446): Flush status journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:12,173 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-20 10:55:12,174 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-20 10:55:12,175 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-20 10:55:12,175 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:12,175 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310312175 2023-03-20 10:55:12,176 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-20 10:55:12,176 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-20 10:55:12,176 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-20 10:55:12,177 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x61c410a9 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:12,182 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd39999, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:12,182 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230320 for table='testGetAfterCompaction' and column='f1' 2023-03-20 10:55:12,224 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,224 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,275 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,275 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,326 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,326 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,377 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,377 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,428 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,428 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,479 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,479 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,530 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,530 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,581 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,582 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,607 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320155e47d4a9614f56b527cdf933340ef1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230320155e47d4a9614f56b527cdf933340ef1 2023-03-20 10:55:12,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testGetAfterCompaction' column='f1' 2023-03-20 10:55:12,619 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:12,620 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54766, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:12,626 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:55:12,628 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:55:12,632 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,632 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,637 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/f1/f241fbe8dda24ae3b999ba16df05cc51 first=Optional[r1] last=Optional[r2] 2023-03-20 10:55:12,637 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/f1/f241fbe8dda24ae3b999ba16df05cc51}] 2023-03-20 10:55:12,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/f1/f241fbe8dda24ae3b999ba16df05cc51 for inclusion in 9a04d71c9b881a10f7def11e77c39298/f1 2023-03-20 10:55:12,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-20 10:55:12,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:55:12,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:12,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/f1/f241fbe8dda24ae3b999ba16df05cc51 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testGetAfterCompaction__johtsecq4bl3u5u0hu5iqelki6n8g26pb9i0b0v4cdv9g3bvo0janrf6mmivkkh5/f1/f241fbe8dda24ae3b999ba16df05cc51 2023-03-20 10:55:12,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testGetAfterCompaction__johtsecq4bl3u5u0hu5iqelki6n8g26pb9i0b0v4cdv9g3bvo0janrf6mmivkkh5/f1/f241fbe8dda24ae3b999ba16df05cc51 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_ 2023-03-20 10:55:12,647 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testGetAfterCompaction__johtsecq4bl3u5u0hu5iqelki6n8g26pb9i0b0v4cdv9g3bvo0janrf6mmivkkh5/f1/f241fbe8dda24ae3b999ba16df05cc51 into 9a04d71c9b881a10f7def11e77c39298/f1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_ - updating store file list. 2023-03-20 10:55:12,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_ into 9a04d71c9b881a10f7def11e77c39298/f1 2023-03-20 10:55:12,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testGetAfterCompaction__johtsecq4bl3u5u0hu5iqelki6n8g26pb9i0b0v4cdv9g3bvo0janrf6mmivkkh5/f1/f241fbe8dda24ae3b999ba16df05cc51 into 9a04d71c9b881a10f7def11e77c39298/f1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_) 2023-03-20 10:55:12,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testGetAfterCompaction__johtsecq4bl3u5u0hu5iqelki6n8g26pb9i0b0v4cdv9g3bvo0janrf6mmivkkh5/f1/f241fbe8dda24ae3b999ba16df05cc51 2023-03-20 10:55:12,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(1912): 9a04d71c9b881a10f7def11e77c39298/f1 is initiating minor compaction 2023-03-20 10:55:12,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@10549fef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:12,651 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9a04d71c9b881a10f7def11e77c39298/f1 in testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:12,651 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/.tmp, totalSize=10.0 K 2023-03-20 10:55:12,651 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 6e7a03ecbf2149c9b3b05872cae4b9ec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:55:12,651 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting fab322d79785415bbaf48c8ea508ec24_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:55:12,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testGetAfterCompaction' column='f1' 2023-03-20 10:55:12,653 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:12,655 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023032006697065bb004bb9acc0f1099594db35 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023032006697065bb004bb9acc0f1099594db35 2023-03-20 10:55:12,656 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303206cb0a0b2b7464261bd2ab926ff166b5b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303206cb0a0b2b7464261bd2ab926ff166b5b 2023-03-20 10:55:12,656 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-20 10:55:12,656 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230320' 2023-03-20 10:55:12,656 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230320 for table='testGetAfterCompaction' and column='f1' 2023-03-20 10:55:12,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-20 10:55:12,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:55:12,658 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-20 10:55:12,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 485 msec 2023-03-20 10:55:12,659 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9a04d71c9b881a10f7def11e77c39298#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:12,683 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,683 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,683 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:12,688 DEBUG [Listener at localhost.localdomain/43657] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-20 10:55:12,692 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-20 10:55:12,692 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44189] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:12,693 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-20 10:55:12,693 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-20 10:55:12,693 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44189] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-20 10:55:12,693 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44189] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. because compaction request was cancelled 2023-03-20 10:55:12,745 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,745 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,745 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:12,796 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,796 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,797 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:12,848 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,848 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,848 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:12,900 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,901 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,901 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:12,953 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,953 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:12,954 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,004 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,005 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,005 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,056 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,056 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,056 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,107 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,107 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,107 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,158 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,158 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,158 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,209 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,209 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,209 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,260 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,260 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,260 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,311 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,311 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,311 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,362 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,362 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,362 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,413 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,413 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,413 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,464 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,464 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,464 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,479 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/.tmp/f1/1c011a307e8242c5af1c53b7410541db as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/1c011a307e8242c5af1c53b7410541db 2023-03-20 10:55:13,485 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 9a04d71c9b881a10f7def11e77c39298/f1 of 9a04d71c9b881a10f7def11e77c39298 into 1c011a307e8242c5af1c53b7410541db(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:13,485 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:13,485 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1679309712651; duration=0sec 2023-03-20 10:55:13,485 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:13,515 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/1c011a307e8242c5af1c53b7410541db; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679309713472; access_time=1679309712656; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,515 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,515 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309712160; access_time=1679309711740; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,515 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679309712603; access_time=1679309712196; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-20 10:55:13,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_] to archive 2023-03-20 10:55:13,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:13,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/6e7a03ecbf2149c9b3b05872cae4b9ec 2023-03-20 10:55:13,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/fab322d79785415bbaf48c8ea508ec24_SeqId_12_ 2023-03-20 10:55:13,566 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/1c011a307e8242c5af1c53b7410541db; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679309713472; access_time=1679309712656; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,566 INFO [Listener at localhost.localdomain/43657] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679309711725; access_time=1679309710910; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-20 10:55:13,693 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:13,693 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a696207 to 127.0.0.1:62837 2023-03-20 10:55:13,693 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,693 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e8d9f94 to 127.0.0.1:62837 2023-03-20 10:55:13,693 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,693 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:13,693 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61c410a9 to 127.0.0.1:62837 2023-03-20 10:55:13,693 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,694 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:13,694 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x632c8c46 to 127.0.0.1:62837 2023-03-20 10:55:13,694 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,694 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:13,694 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e9b6631 to 127.0.0.1:62837 2023-03-20 10:55:13,694 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,694 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19dfec4b to 127.0.0.1:62837 2023-03-20 10:55:13,694 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,694 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:13,696 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x652b92b4 to 127.0.0.1:62837 2023-03-20 10:55:13,696 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:13,701 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-20 10:55:13,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-03-20 10:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:13,712 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309713712"}]},"ts":"1679309713712"} 2023-03-20 10:55:13,713 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-20 10:55:13,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-20 10:55:13,714 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-20 10:55:13,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, UNASSIGN}] 2023-03-20 10:55:13,717 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, UNASSIGN 2023-03-20 10:55:13,718 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9a04d71c9b881a10f7def11e77c39298, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:13,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679309713718"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309713718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309713718"}]},"ts":"1679309713718"} 2023-03-20 10:55:13,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 9a04d71c9b881a10f7def11e77c39298, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:13,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-20 10:55:13,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:13,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9a04d71c9b881a10f7def11e77c39298, disabling compactions & flushes 2023-03-20 10:55:13,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:13,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:13,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. after waiting 0 ms 2023-03-20 10:55:13,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:13,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-20 10:55:13,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-20 10:55:13,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298. 2023-03-20 10:55:13,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9a04d71c9b881a10f7def11e77c39298: 2023-03-20 10:55:13,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:13,887 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9a04d71c9b881a10f7def11e77c39298, regionState=CLOSED 2023-03-20 10:55:13,887 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679309713887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309713887"}]},"ts":"1679309713887"} 2023-03-20 10:55:13,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-20 10:55:13,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 9a04d71c9b881a10f7def11e77c39298, server=jenkins-hbase20.apache.org,44189,1679309623230 in 169 msec 2023-03-20 10:55:13,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-20 10:55:13,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a04d71c9b881a10f7def11e77c39298, UNASSIGN in 174 msec 2023-03-20 10:55:13,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309713892"}]},"ts":"1679309713892"} 2023-03-20 10:55:13,894 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-20 10:55:13,895 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-20 10:55:13,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 190 msec 2023-03-20 10:55:14,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-20 10:55:14,019 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-20 10:55:14,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-03-20 10:55:14,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:14,039 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:14,041 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:14,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-20 10:55:14,044 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:14,045 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1, FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/recovered.edits] 2023-03-20 10:55:14,048 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/1c011a307e8242c5af1c53b7410541db to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/1c011a307e8242c5af1c53b7410541db 2023-03-20 10:55:14,049 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/f1/44a82e546bbe4278b0f652c4ace7b1db 2023-03-20 10:55:14,051 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/recovered.edits/15.seqid to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298/recovered.edits/15.seqid 2023-03-20 10:55:14,051 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testGetAfterCompaction/9a04d71c9b881a10f7def11e77c39298 2023-03-20 10:55:14,051 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-20 10:55:14,052 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-20 10:55:14,052 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-20 10:55:14,056 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230320155e47d4a9614f56b527cdf933340ef1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230320155e47d4a9614f56b527cdf933340ef1 2023-03-20 10:55:14,057 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-20 10:55:14,059 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:14,082 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-20 10:55:14,084 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-20 10:55:14,085 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:14,085 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-20 10:55:14,085 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679309714085"}]},"ts":"9223372036854775807"} 2023-03-20 10:55:14,086 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-20 10:55:14,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9a04d71c9b881a10f7def11e77c39298, NAME => 'testGetAfterCompaction,,1679309708785.9a04d71c9b881a10f7def11e77c39298.', STARTKEY => '', ENDKEY => ''}] 2023-03-20 10:55:14,087 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-20 10:55:14,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1679309714087"}]},"ts":"9223372036854775807"} 2023-03-20 10:55:14,088 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-20 10:55:14,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-20 10:55:14,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 59 msec 2023-03-20 10:55:14,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-20 10:55:14,143 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-20 10:55:14,160 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242 (was 252), OpenFileDescriptor=602 (was 638), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 366), ProcessCount=187 (was 187), AvailableMemoryMB=8811 (was 8859) 2023-03-20 10:55:14,173 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=242, OpenFileDescriptor=602, MaxFileDescriptor=60000, SystemLoadAverage=337, ProcessCount=187, AvailableMemoryMB=8811 2023-03-20 10:55:14,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-20 10:55:14,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-20 10:55:14,177 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:55:14,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-20 10:55:14,178 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:55:14,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-20 10:55:14,180 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:14,180 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:14,180 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:14,180 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 empty. 2023-03-20 10:55:14,180 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 empty. 2023-03-20 10:55:14,180 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 empty. 2023-03-20 10:55:14,181 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:14,181 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:14,182 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:14,182 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-20 10:55:14,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-20 10:55:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-20 10:55:14,594 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-20 10:55:14,598 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c8cd4be4947fdf88edb1fdf8adc4035, NAME => 'testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:14,599 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => e0ef86d3f8b59492e591fb6178d48b92, NAME => 'testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:14,599 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => c00186bd850f4540e39bc2caef12c922, NAME => 'testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:14,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-20 10:55:15,010 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:15,010 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing c00186bd850f4540e39bc2caef12c922, disabling compactions & flushes 2023-03-20 10:55:15,010 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,010 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,010 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. after waiting 0 ms 2023-03-20 10:55:15,010 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,010 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,010 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:15,012 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:15,012 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 3c8cd4be4947fdf88edb1fdf8adc4035, disabling compactions & flushes 2023-03-20 10:55:15,013 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. after waiting 0 ms 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,013 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing e0ef86d3f8b59492e591fb6178d48b92, disabling compactions & flushes 2023-03-20 10:55:15,013 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. after waiting 0 ms 2023-03-20 10:55:15,013 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,014 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,014 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:15,016 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:55:15,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309715016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309715016"}]},"ts":"1679309715016"} 2023-03-20 10:55:15,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309715016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309715016"}]},"ts":"1679309715016"} 2023-03-20 10:55:15,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309715016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309715016"}]},"ts":"1679309715016"} 2023-03-20 10:55:15,019 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-20 10:55:15,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:55:15,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309715020"}]},"ts":"1679309715020"} 2023-03-20 10:55:15,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-20 10:55:15,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN}] 2023-03-20 10:55:15,027 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN 2023-03-20 10:55:15,028 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN 2023-03-20 10:55:15,028 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN 2023-03-20 10:55:15,028 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:15,028 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:15,028 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:15,180 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=e0ef86d3f8b59492e591fb6178d48b92, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:15,180 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c00186bd850f4540e39bc2caef12c922, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:15,180 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=3c8cd4be4947fdf88edb1fdf8adc4035, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:15,180 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309715180"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309715180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309715180"}]},"ts":"1679309715180"} 2023-03-20 10:55:15,180 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309715180"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309715180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309715180"}]},"ts":"1679309715180"} 2023-03-20 10:55:15,181 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309715180"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309715180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309715180"}]},"ts":"1679309715180"} 2023-03-20 10:55:15,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure e0ef86d3f8b59492e591fb6178d48b92, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:15,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure c00186bd850f4540e39bc2caef12c922, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:15,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 3c8cd4be4947fdf88edb1fdf8adc4035, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:15,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-20 10:55:15,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0ef86d3f8b59492e591fb6178d48b92, NAME => 'testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.', STARTKEY => '2', ENDKEY => ''} 2023-03-20 10:55:15,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:15,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,342 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,345 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:15,345 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:15,346 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0ef86d3f8b59492e591fb6178d48b92 columnFamilyName family1 2023-03-20 10:55:15,347 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(310): Store=e0ef86d3f8b59492e591fb6178d48b92/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:15,348 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,349 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2 2023-03-20 10:55:15,349 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2 2023-03-20 10:55:15,349 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0ef86d3f8b59492e591fb6178d48b92 columnFamilyName family2 2023-03-20 10:55:15,350 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(310): Store=e0ef86d3f8b59492e591fb6178d48b92/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:15,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:15,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:15,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e0ef86d3f8b59492e591fb6178d48b92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67944628, jitterRate=0.012453854084014893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:15,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:15,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92., pid=83, masterSystemTime=1679309715335 2023-03-20 10:55:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:15,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c8cd4be4947fdf88edb1fdf8adc4035, NAME => 'testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.', STARTKEY => '', ENDKEY => '1'} 2023-03-20 10:55:15,358 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=e0ef86d3f8b59492e591fb6178d48b92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309715358"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309715358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309715358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309715358"}]},"ts":"1679309715358"} 2023-03-20 10:55:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,359 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-03-20 10:55:15,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure e0ef86d3f8b59492e591fb6178d48b92, server=jenkins-hbase20.apache.org,44189,1679309623230 in 177 msec 2023-03-20 10:55:15,361 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:15,361 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:15,361 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8cd4be4947fdf88edb1fdf8adc4035 columnFamilyName family1 2023-03-20 10:55:15,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN in 336 msec 2023-03-20 10:55:15,362 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(310): Store=3c8cd4be4947fdf88edb1fdf8adc4035/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:15,362 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,363 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2 2023-03-20 10:55:15,363 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2 2023-03-20 10:55:15,364 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8cd4be4947fdf88edb1fdf8adc4035 columnFamilyName family2 2023-03-20 10:55:15,364 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(310): Store=3c8cd4be4947fdf88edb1fdf8adc4035/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:15,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:15,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:15,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:15,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3c8cd4be4947fdf88edb1fdf8adc4035; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67281463, jitterRate=0.0025719255208969116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:15,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:15,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035., pid=85, masterSystemTime=1679309715335 2023-03-20 10:55:15,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:15,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c00186bd850f4540e39bc2caef12c922, NAME => 'testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.', STARTKEY => '1', ENDKEY => '2'} 2023-03-20 10:55:15,371 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=3c8cd4be4947fdf88edb1fdf8adc4035, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:15,371 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309715371"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309715371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309715371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309715371"}]},"ts":"1679309715371"} 2023-03-20 10:55:15,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:15,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,373 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-03-20 10:55:15,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 3c8cd4be4947fdf88edb1fdf8adc4035, server=jenkins-hbase20.apache.org,44189,1679309623230 in 189 msec 2023-03-20 10:55:15,374 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:15,374 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:15,374 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c00186bd850f4540e39bc2caef12c922 columnFamilyName family1 2023-03-20 10:55:15,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN in 350 msec 2023-03-20 10:55:15,375 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(310): Store=c00186bd850f4540e39bc2caef12c922/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:15,375 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,376 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2 2023-03-20 10:55:15,376 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2 2023-03-20 10:55:15,377 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c00186bd850f4540e39bc2caef12c922 columnFamilyName family2 2023-03-20 10:55:15,377 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(310): Store=c00186bd850f4540e39bc2caef12c922/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:15,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:15,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:15,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c00186bd850f4540e39bc2caef12c922; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72364352, jitterRate=0.07831287384033203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:15,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:15,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922., pid=84, masterSystemTime=1679309715335 2023-03-20 10:55:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:15,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c00186bd850f4540e39bc2caef12c922, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:15,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309715384"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309715384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309715384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309715384"}]},"ts":"1679309715384"} 2023-03-20 10:55:15,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-03-20 10:55:15,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure c00186bd850f4540e39bc2caef12c922, server=jenkins-hbase20.apache.org,44189,1679309623230 in 202 msec 2023-03-20 10:55:15,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-20 10:55:15,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN in 362 msec 2023-03-20 10:55:15,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:55:15,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309715387"}]},"ts":"1679309715387"} 2023-03-20 10:55:15,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-20 10:55:15,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:55:15,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2130 sec 2023-03-20 10:55:16,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-20 10:55:16,287 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-20 10:55:16,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:16,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:16,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:16,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:16,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-20 10:55:16,305 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-20 10:55:16,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:16,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-20 10:55:16,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-20 10:55:16,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:16,305 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:16,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:16,306 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:16,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:16,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:16,306 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:16,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:16,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:16,307 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-20 10:55:16,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-20 10:55:16,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-20 10:55:16,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:16,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-20 10:55:16,307 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:16,307 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. started... 2023-03-20 10:55:16,307 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:16,307 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:16,308 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:16,307 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. started... 2023-03-20 10:55:16,308 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:16,308 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. started... 2023-03-20 10:55:16,308 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c00186bd850f4540e39bc2caef12c922 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:55:16,308 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0ef86d3f8b59492e591fb6178d48b92 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:55:16,308 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3c8cd4be4947fdf88edb1fdf8adc4035 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:55:16,323 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a 2023-03-20 10:55:16,723 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 2023-03-20 10:55:16,723 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa 2023-03-20 10:55:16,728 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/1c6edeb65fba49f2990a4aa1b11f9364 2023-03-20 10:55:16,728 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/b770f2e4165844348c4edba8d880b2fb 2023-03-20 10:55:16,728 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/d0d25d6c489d4ca48325361a1b46fa13 2023-03-20 10:55:17,152 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320c927ee77e7964836a7f9a3fbcd394eed to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c927ee77e7964836a7f9a3fbcd394eed 2023-03-20 10:55:17,152 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032078c039e8283a4f8d9a2370b4a2934983 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032078c039e8283a4f8d9a2370b4a2934983 2023-03-20 10:55:17,152 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320d268597120074a94819db3e1024a663d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d268597120074a94819db3e1024a663d 2023-03-20 10:55:17,561 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/ec5cbb67fa6c46c28a7336685398e8a4 2023-03-20 10:55:17,561 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/99e1a51dbabf41009722cdb2477273c7 2023-03-20 10:55:17,562 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/4d52e9fe9b92417088c18666c5facd2b 2023-03-20 10:55:17,567 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/1c6edeb65fba49f2990a4aa1b11f9364 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364 2023-03-20 10:55:17,568 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/b770f2e4165844348c4edba8d880b2fb as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb 2023-03-20 10:55:17,568 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/d0d25d6c489d4ca48325361a1b46fa13 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13 2023-03-20 10:55:17,572 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364, entries=4, sequenceid=5, filesize=5.4 K 2023-03-20 10:55:17,573 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/ec5cbb67fa6c46c28a7336685398e8a4 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4 2023-03-20 10:55:17,574 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13, entries=4, sequenceid=5, filesize=5.4 K 2023-03-20 10:55:17,574 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb, entries=4, sequenceid=5, filesize=5.4 K 2023-03-20 10:55:17,575 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/99e1a51dbabf41009722cdb2477273c7 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7 2023-03-20 10:55:17,575 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/4d52e9fe9b92417088c18666c5facd2b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b 2023-03-20 10:55:17,578 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:55:17,579 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e0ef86d3f8b59492e591fb6178d48b92 in 1271ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:17,579 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-20 10:55:17,580 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:17,580 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:17,580 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:55:17,580 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:17,580 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:55:17,581 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3c8cd4be4947fdf88edb1fdf8adc4035 in 1273ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:17,582 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:17,582 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:17,582 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:17,583 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c00186bd850f4540e39bc2caef12c922 in 1275ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:17,583 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:17,583 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:17,583 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:17,583 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:17,583 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,584 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-20 10:55:17,584 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-20 10:55:17,584 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,584 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:17,585 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,585 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-20 10:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@633d2de0[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:17,586 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-20 10:55:17,586 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,587 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,587 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,587 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:17,587 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-20 10:55:17,587 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-20 10:55:17,587 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:17,588 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-20 10:55:17,588 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,588 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,588 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-20 10:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:17,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-20 10:55:17,589 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-20 10:55:17,590 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:17,590 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:17,590 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-20 10:55:17,590 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:17,591 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,591 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:17,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,591 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:17,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:17,591 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,592 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,594 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:17,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:17,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-20 10:55:17,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:17,594 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,595 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:17,595 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:17,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:17,695 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:17,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:17,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:17,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:17,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-20 10:55:17,702 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-20 10:55:17,702 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:17,702 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-20 10:55:17,702 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-20 10:55:17,702 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,702 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:17,703 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:17,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:17,703 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:17,703 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:17,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:17,704 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-20 10:55:17,704 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-20 10:55:17,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-20 10:55:17,704 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-20 10:55:17,704 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:17,704 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-20 10:55:17,704 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:17,704 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. started... 2023-03-20 10:55:17,704 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c00186bd850f4540e39bc2caef12c922 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:55:17,706 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:17,706 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. started... 2023-03-20 10:55:17,706 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3c8cd4be4947fdf88edb1fdf8adc4035 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:55:17,711 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:17,711 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:17,711 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:17,711 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. started... 2023-03-20 10:55:17,711 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0ef86d3f8b59492e591fb6178d48b92 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:55:18,139 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 2023-03-20 10:55:18,139 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 2023-03-20 10:55:18,139 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb 2023-03-20 10:55:18,546 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/0583b0cfc4e8452bb43edac5d5782662 2023-03-20 10:55:18,546 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/71dc519219b8466f844ddce23e2ba862 2023-03-20 10:55:18,546 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/1dcd99f49ca8459dba4bf3e28d495382 2023-03-20 10:55:18,964 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320844784c5c05749ed965bd7967a75075b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320844784c5c05749ed965bd7967a75075b 2023-03-20 10:55:18,964 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032011a6e2b982484f4786dffa9a23d8c738 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032011a6e2b982484f4786dffa9a23d8c738 2023-03-20 10:55:18,969 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303201ea3feeb8a7548218ff749ab5e007b60 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303201ea3feeb8a7548218ff749ab5e007b60 2023-03-20 10:55:19,371 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/0ef7d64a2176478fa569dbdea08c79f7 2023-03-20 10:55:19,371 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/46c4378844f14aa8af546f3c7309c670 2023-03-20 10:55:19,375 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/e1d079c267a640e3961b321f446bc7bf 2023-03-20 10:55:19,376 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/1dcd99f49ca8459dba4bf3e28d495382 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382 2023-03-20 10:55:19,376 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/71dc519219b8466f844ddce23e2ba862 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862 2023-03-20 10:55:19,378 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/0583b0cfc4e8452bb43edac5d5782662 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662 2023-03-20 10:55:19,379 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382, entries=4, sequenceid=9, filesize=5.4 K 2023-03-20 10:55:19,379 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862, entries=4, sequenceid=9, filesize=5.4 K 2023-03-20 10:55:19,379 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/46c4378844f14aa8af546f3c7309c670 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670 2023-03-20 10:55:19,379 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/0ef7d64a2176478fa569dbdea08c79f7 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7 2023-03-20 10:55:19,382 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662, entries=4, sequenceid=9, filesize=5.4 K 2023-03-20 10:55:19,382 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:55:19,382 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:55:19,382 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/e1d079c267a640e3961b321f446bc7bf as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf 2023-03-20 10:55:19,382 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3c8cd4be4947fdf88edb1fdf8adc4035 in 1676ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:19,383 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:19,383 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:19,383 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:19,383 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c00186bd850f4540e39bc2caef12c922 in 1679ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:19,383 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:19,383 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:19,383 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:19,385 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:55:19,386 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:55:19,386 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e0ef86d3f8b59492e591fb6178d48b92 in 1675ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:19,386 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:19,386 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:19,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:19,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:19,386 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,387 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-20 10:55:19,387 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-20 10:55:19,388 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,388 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:19,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,390 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:19,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-20 10:55:19,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d9749a2[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:19,391 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-20 10:55:19,391 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,392 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-20 10:55:19,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-20 10:55:19,392 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,392 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:19,392 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:19,393 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-20 10:55:19,393 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,393 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:19,393 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-20 10:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:19,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-20 10:55:19,395 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-20 10:55:19,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:19,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:19,395 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-20 10:55:19,395 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:19,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,396 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:19,396 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,397 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:19,398 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:19,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-20 10:55:19,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,398 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:19,399 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:19,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:19,399 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:19,399 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:19,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:19,499 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:19,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:19,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:19,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:19,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:19,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:19,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:19,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-20 10:55:19,512 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-20 10:55:19,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:19,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-20 10:55:19,512 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-20 10:55:19,513 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,513 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:19,514 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,514 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:19,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:19,514 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:19,514 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:19,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:19,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-20 10:55:19,515 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-20 10:55:19,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-20 10:55:19,515 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-20 10:55:19,515 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:19,516 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-20 10:55:19,516 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:19,516 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:19,516 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. started... 2023-03-20 10:55:19,516 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. started... 2023-03-20 10:55:19,516 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:19,516 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3c8cd4be4947fdf88edb1fdf8adc4035 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:55:19,516 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c00186bd850f4540e39bc2caef12c922 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:55:19,516 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:19,516 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:19,516 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. started... 2023-03-20 10:55:19,516 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0ef86d3f8b59492e591fb6178d48b92 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:55:19,941 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 2023-03-20 10:55:19,943 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c 2023-03-20 10:55:19,944 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da 2023-03-20 10:55:20,350 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b 2023-03-20 10:55:20,350 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/21d8115aba044a059792bc558b24da8b 2023-03-20 10:55:20,350 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/c4b57356f6264512a450e9873de12bd4 2023-03-20 10:55:20,771 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320c30c62dd1c924654afbae160d098e5c1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320c30c62dd1c924654afbae160d098e5c1 2023-03-20 10:55:20,774 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320c25d91f7c884446787f0f95745d5d990 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c25d91f7c884446787f0f95745d5d990 2023-03-20 10:55:20,774 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032046c0f96066aa46d0b372b51a1ca9dd7e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032046c0f96066aa46d0b372b51a1ca9dd7e 2023-03-20 10:55:20,776 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/c4a18005f56f4e4e99df9afb595d587d 2023-03-20 10:55:20,778 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/9bfe3c70c8534469bd6f91dbe095148c 2023-03-20 10:55:20,780 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b 2023-03-20 10:55:20,781 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/21d8115aba044a059792bc558b24da8b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b 2023-03-20 10:55:20,783 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b, entries=4, sequenceid=13, filesize=5.4 K 2023-03-20 10:55:20,784 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/c4a18005f56f4e4e99df9afb595d587d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d 2023-03-20 10:55:20,784 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b, entries=4, sequenceid=13, filesize=5.4 K 2023-03-20 10:55:20,785 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/9bfe3c70c8534469bd6f91dbe095148c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c 2023-03-20 10:55:20,787 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:55:20,788 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3c8cd4be4947fdf88edb1fdf8adc4035 in 1272ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:20,788 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:20,788 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:20,788 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:20,791 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:55:20,792 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e0ef86d3f8b59492e591fb6178d48b92 in 1276ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:20,792 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:20,792 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:20,792 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:21,179 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/db04c9df44be43bab07be36df0261c69 2023-03-20 10:55:21,183 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/c4b57356f6264512a450e9873de12bd4 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4 2023-03-20 10:55:21,187 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4, entries=4, sequenceid=13, filesize=5.4 K 2023-03-20 10:55:21,188 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/db04c9df44be43bab07be36df0261c69 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69 2023-03-20 10:55:21,192 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:55:21,193 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c00186bd850f4540e39bc2caef12c922 in 1677ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:21,193 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:21,193 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-20 10:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-20 10:55:21,196 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,196 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:21,197 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:21,197 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:21,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-20 10:55:21,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df58f3e[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:21,198 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-20 10:55:21,198 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,198 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,199 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,199 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:21,199 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-20 10:55:21,199 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-20 10:55:21,199 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:21,199 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-20 10:55:21,199 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:21,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-20 10:55:21,200 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:21,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-20 10:55:21,201 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-20 10:55:21,202 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:21,202 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:21,202 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-20 10:55:21,202 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:21,202 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,203 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,203 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:21,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:21,203 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:21,204 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:21,206 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:21,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-20 10:55:21,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-20 10:55:21,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:21,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:21,206 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:21,307 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:21,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:21,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:21,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:21,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:21,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:21,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:21,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-20 10:55:21,314 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-20 10:55:21,314 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:21,314 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-20 10:55:21,314 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-20 10:55:21,315 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,315 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:21,316 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:21,316 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:21,316 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:21,316 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:21,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:21,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-20 10:55:21,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-20 10:55:21,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-20 10:55:21,322 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-20 10:55:21,322 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:21,322 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-20 10:55:21,323 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:21,323 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. started... 2023-03-20 10:55:21,323 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c00186bd850f4540e39bc2caef12c922 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:55:21,323 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:21,323 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:21,323 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:21,323 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:21,324 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. started... 2023-03-20 10:55:21,324 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. started... 2023-03-20 10:55:21,324 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3c8cd4be4947fdf88edb1fdf8adc4035 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:55:21,324 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0ef86d3f8b59492e591fb6178d48b92 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:55:21,352 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad 2023-03-20 10:55:21,352 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 2023-03-20 10:55:21,355 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c 2023-03-20 10:55:21,743 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-20 10:55:21,782 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/3a3f1be0321048819f4959d5e5047023 2023-03-20 10:55:21,782 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/7a5970f13ed04f62a91d8e921981fb6e 2023-03-20 10:55:21,782 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/bc3d2821a41e45158b2cf509744dc526 2023-03-20 10:55:22,207 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320af884cfd55d245a4b5979c2a14f93464 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320af884cfd55d245a4b5979c2a14f93464 2023-03-20 10:55:22,211 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032022857f40302e49978009dba4a600fc10 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032022857f40302e49978009dba4a600fc10 2023-03-20 10:55:22,213 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320ae6c6bd8b18246ceaf8bf2d018d787b0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320ae6c6bd8b18246ceaf8bf2d018d787b0 2023-03-20 10:55:22,223 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/3ac497c49457427caf6a8e7cd5c105bc 2023-03-20 10:55:22,226 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/5472a8e7a2c548ceac231c2b5bbdbf3e 2023-03-20 10:55:22,229 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/3a3f1be0321048819f4959d5e5047023 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023 2023-03-20 10:55:22,231 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/7a5970f13ed04f62a91d8e921981fb6e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e 2023-03-20 10:55:22,233 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023, entries=4, sequenceid=17, filesize=5.4 K 2023-03-20 10:55:22,238 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/3ac497c49457427caf6a8e7cd5c105bc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc 2023-03-20 10:55:22,240 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e, entries=4, sequenceid=17, filesize=5.4 K 2023-03-20 10:55:22,241 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/5472a8e7a2c548ceac231c2b5bbdbf3e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e 2023-03-20 10:55:22,241 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:55:22,242 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c00186bd850f4540e39bc2caef12c922 in 919ms, sequenceid=17, compaction requested=true 2023-03-20 10:55:22,242 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:22,242 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:22,242 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:22,245 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:55:22,246 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e0ef86d3f8b59492e591fb6178d48b92 in 922ms, sequenceid=17, compaction requested=true 2023-03-20 10:55:22,246 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:22,246 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:22,246 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:22,625 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/12a74287105f40fa973d0144fbd31976 2023-03-20 10:55:22,629 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/bc3d2821a41e45158b2cf509744dc526 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526 2023-03-20 10:55:22,633 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526, entries=4, sequenceid=17, filesize=5.4 K 2023-03-20 10:55:22,634 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/12a74287105f40fa973d0144fbd31976 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976 2023-03-20 10:55:22,638 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:55:22,639 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3c8cd4be4947fdf88edb1fdf8adc4035 in 1315ms, sequenceid=17, compaction requested=true 2023-03-20 10:55:22,639 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:22,639 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:22,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:22,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:22,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,639 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-20 10:55:22,640 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-20 10:55:22,640 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,640 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:22,641 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:22,641 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:22,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-20 10:55:22,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bd63aff[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:22,642 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-20 10:55:22,642 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,642 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,643 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-20 10:55:22,643 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-20 10:55:22,643 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,643 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:22,643 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:22,643 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,644 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-20 10:55:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:22,644 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:22,644 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-20 10:55:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:22,646 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-20 10:55:22,646 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:22,646 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:22,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-20 10:55:22,646 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-20 10:55:22,646 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:22,647 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,647 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:22,647 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:22,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,647 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:22,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:22,648 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:22,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-20 10:55:22,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:22,650 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:22,650 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:22,651 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:22,651 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:22,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-20 10:55:22,652 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:22,652 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:22,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:22,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:22,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:22,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:22,751 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:22,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:22,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679309722761 (current time:1679309722761). 2023-03-20 10:55:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-20 10:55:22,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] zookeeper.ReadOnlyZKClient(139): Connect 0x2303e54b to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:22,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f8e77c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:22,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:22,775 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58762, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:22,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2303e54b to 127.0.0.1:62837 2023-03-20 10:55:22,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:22,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-20 10:55:22,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:22,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-20 10:55:22,784 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-20 10:55:22,785 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679310322785 2023-03-20 10:55:22,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:22,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1679309722752 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-20 10:55:22,787 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-20 10:55:22,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-20 10:55:22,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-03-20 10:55:22,789 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-20 10:55:22,789 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1679310322789 2023-03-20 10:55:22,792 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:22,792 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-20 10:55:22,892 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:22,896 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-20 10:55:23,097 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:23,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:23,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:23,098 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-20 10:55:23,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1679309722752 2023-03-20 10:55:23,207 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1679309722752' 2023-03-20 10:55:23,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-20 10:55:23,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1679309722752' starting 'acquire' 2023-03-20 10:55:23,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1679309722752', kicking off acquire phase on members. 2023-03-20 10:55:23,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,207 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1679309722752 2023-03-20 10:55:23,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,208 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-20 10:55:23,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-20 10:55:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-20 10:55:23,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1679309722752 2023-03-20 10:55:23,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-20 10:55:23,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1679309722752 2023-03-20 10:55:23,209 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1679309722752 from table testCompactionWithHFileLink type FLUSH 2023-03-20 10:55:23,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1679309722752 2023-03-20 10:55:23,212 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1679309722752' with timeout 300000ms 2023-03-20 10:55:23,212 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-20 10:55:23,212 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1679309722752' starting 'acquire' stage 2023-03-20 10:55:23,212 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1679309722752' locally acquired 2023-03-20 10:55:23,212 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (snaptb-1679309722752) in zk 2023-03-20 10:55:23,213 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,213 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-20 10:55:23,214 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,214 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1679309722752' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679309722752 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:23,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'snaptb-1679309722752' on coordinator 2023-03-20 10:55:23,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@510e5e48[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:23,215 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1679309722752' starting 'in-barrier' execution. 2023-03-20 10:55:23,215 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,215 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,215 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1679309722752' received 'reached' from coordinator. 2023-03-20 10:55:23,216 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,216 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:23,216 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:23,216 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:23,216 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-20 10:55:23,216 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:23,216 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-20 10:55:23,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. started... 2023-03-20 10:55:23,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. started... 2023-03-20 10:55:23,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. started... 2023-03-20 10:55:23,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:23,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:23,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:23,218 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.' region-info for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,218 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.' region-info for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,218 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.' region-info for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,221 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-20 10:55:23,221 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-20 10:55:23,221 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-20 10:55:23,396 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-20 10:55:23,397 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e] hfiles 2023-03-20 10:55:23,397 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023] hfiles 2023-03-20 10:55:23,397 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526] hfiles 2023-03-20 10:55:23,397 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,397 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,398 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,398 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:23,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:23,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:23,401 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976] hfiles 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e] hfiles 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc] hfiles 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,403 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,403 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976 for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,403 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,430 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. completed. 2023-03-20 10:55:23,430 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:23,431 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-20 10:55:23,435 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. completed. 2023-03-20 10:55:23,435 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:23,435 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-20 10:55:23,840 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. completed. 2023-03-20 10:55:23,840 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:23,840 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-20 10:55:23,840 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-20 10:55:23,840 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,841 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1679309722752' locally completed 2023-03-20 10:55:23,841 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1679309722752' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:23,842 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1679309722752' has notified controller of completion 2023-03-20 10:55:23,842 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:23,842 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,842 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1679309722752' completed. 2023-03-20 10:55:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-20 10:55:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679309722752 2023-03-20 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679309722752 2023-03-20 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1679309722752' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:23,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'snaptb-1679309722752', counting down latch. Waiting for 0 more 2023-03-20 10:55:23,845 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1679309722752' execution completed 2023-03-20 10:55:23,845 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:23,845 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:23,845 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1679309722752 2023-03-20 10:55:23,845 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1679309722752including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-20 10:55:23,846 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,846 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-20 10:55:23,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,846 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:23,846 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-20 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679309722752 2023-03-20 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679309722752 2023-03-20 10:55:23,847 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679309722752 2023-03-20 10:55:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,848 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,848 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679309722752 2023-03-20 10:55:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-20 10:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-20 10:55:23,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1679309722752 because node does not exist (not an error) 2023-03-20 10:55:23,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1679309722752 2023-03-20 10:55:23,849 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679309722752 2023-03-20 10:55:23,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679309722752/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1679309722752 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679309722752 2023-03-20 10:55:23,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-20 10:55:23,849 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679309722752 2023-03-20 10:55:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-20 10:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24] mob files 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c 2023-03-20 10:55:23,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032011a6e2b982484f4786dffa9a23d8c738, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032046c0f96066aa46d0b372b51a1ca9dd7e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320af884cfd55d245a4b5979c2a14f93464, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d268597120074a94819db3e1024a663d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303201ea3feeb8a7548218ff749ab5e007b60, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320ae6c6bd8b18246ceaf8bf2d018d787b0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c25d91f7c884446787f0f95745d5d990, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c927ee77e7964836a7f9a3fbcd394eed, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032022857f40302e49978009dba4a600fc10, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032078c039e8283a4f8d9a2370b4a2934983, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320844784c5c05749ed965bd7967a75075b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320c30c62dd1c924654afbae160d098e5c1] mob files 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032011a6e2b982484f4786dffa9a23d8c738 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032046c0f96066aa46d0b372b51a1ca9dd7e 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320af884cfd55d245a4b5979c2a14f93464 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d268597120074a94819db3e1024a663d 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303201ea3feeb8a7548218ff749ab5e007b60 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320ae6c6bd8b18246ceaf8bf2d018d787b0 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c25d91f7c884446787f0f95745d5d990 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c927ee77e7964836a7f9a3fbcd394eed 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032022857f40302e49978009dba4a600fc10 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032078c039e8283a4f8d9a2370b4a2934983 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320844784c5c05749ed965bd7967a75075b 2023-03-20 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320c30c62dd1c924654afbae160d098e5c1 2023-03-20 10:55:23,901 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:23,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:23,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:23,904 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-20 10:55:24,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1679309722752 2023-03-20 10:55:24,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/snaptb-1679309722752 2023-03-20 10:55:24,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/snaptb-1679309722752 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/snaptb-1679309722752 2023-03-20 10:55:24,904 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:24,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:24,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:24,905 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-20 10:55:25,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1679309722752 of table testCompactionWithHFileLink completed 2023-03-20 10:55:25,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/snaptb-1679309722752 2023-03-20 10:55:25,126 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/snaptb-1679309722752 2023-03-20 10:55:25,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1679309722752 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679309722786Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1679309724256 (+1470 ms)Consolidate snapshot: snaptb-1679309722752 at 1679309724256Loading Region manifests for snaptb-1679309722752 at 1679309724256Writing data manifest for snaptb-1679309722752 at 1679309724271 (+15 ms)Verifying snapshot: snaptb-1679309722752 at 1679309724683 (+412 ms)Snapshot snaptb-1679309722752 of table testCompactionWithHFileLink completed at 1679309725125 (+442 ms) 2023-03-20 10:55:25,127 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-20 10:55:25,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.3400 sec 2023-03-20 10:55:26,905 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:26,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:26,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-20 10:55:26,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:26,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:26,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-20 10:55:26,941 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-20 10:55:26,941 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:26,941 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-20 10:55:26,941 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-20 10:55:26,941 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:26,941 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:26,942 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:26,942 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:26,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:26,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:26,942 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:26,942 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:26,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:26,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:26,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-20 10:55:26,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-20 10:55:26,943 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-20 10:55:26,943 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:26,943 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-20 10:55:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. started... 2023-03-20 10:55:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:26,943 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:26,943 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:26,943 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c00186bd850f4540e39bc2caef12c922 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:55:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. started... 2023-03-20 10:55:26,943 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. started... 2023-03-20 10:55:26,943 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3c8cd4be4947fdf88edb1fdf8adc4035 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:55:26,943 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0ef86d3f8b59492e591fb6178d48b92 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:55:27,246 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:55:27,358 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/d40a9f90167248feba5280090f8fefdc 2023-03-20 10:55:27,362 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40a9f90167248feba5280090f8fefdc 2023-03-20 10:55:27,757 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/5daa15359f3e4f698a48d40eb165fe43 2023-03-20 10:55:27,761 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/76aaf992f38343f3b1b5dabda784c946 2023-03-20 10:55:27,766 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5daa15359f3e4f698a48d40eb165fe43 2023-03-20 10:55:27,768 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76aaf992f38343f3b1b5dabda784c946 2023-03-20 10:55:28,177 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/026216ce9c85457180ac4084433ee228 2023-03-20 10:55:28,185 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 026216ce9c85457180ac4084433ee228 2023-03-20 10:55:28,185 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/58ba7b1576ba4eb2904c56b40ac703bc 2023-03-20 10:55:28,186 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/979ad85edb884aad95bd4dff1feefe69 2023-03-20 10:55:28,186 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/d40a9f90167248feba5280090f8fefdc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d40a9f90167248feba5280090f8fefdc 2023-03-20 10:55:28,189 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 979ad85edb884aad95bd4dff1feefe69 2023-03-20 10:55:28,189 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58ba7b1576ba4eb2904c56b40ac703bc 2023-03-20 10:55:28,189 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40a9f90167248feba5280090f8fefdc 2023-03-20 10:55:28,189 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/76aaf992f38343f3b1b5dabda784c946 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/76aaf992f38343f3b1b5dabda784c946 2023-03-20 10:55:28,189 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d40a9f90167248feba5280090f8fefdc, entries=3, sequenceid=24, filesize=5.0 K 2023-03-20 10:55:28,189 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/5daa15359f3e4f698a48d40eb165fe43 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/5daa15359f3e4f698a48d40eb165fe43 2023-03-20 10:55:28,190 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/026216ce9c85457180ac4084433ee228 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/026216ce9c85457180ac4084433ee228 2023-03-20 10:55:28,194 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76aaf992f38343f3b1b5dabda784c946 2023-03-20 10:55:28,195 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/76aaf992f38343f3b1b5dabda784c946, entries=3, sequenceid=24, filesize=5.0 K 2023-03-20 10:55:28,195 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 026216ce9c85457180ac4084433ee228 2023-03-20 10:55:28,195 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/026216ce9c85457180ac4084433ee228, entries=1, sequenceid=24, filesize=5.0 K 2023-03-20 10:55:28,195 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5daa15359f3e4f698a48d40eb165fe43 2023-03-20 10:55:28,195 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/5daa15359f3e4f698a48d40eb165fe43, entries=3, sequenceid=24, filesize=5.0 K 2023-03-20 10:55:28,195 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/979ad85edb884aad95bd4dff1feefe69 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/979ad85edb884aad95bd4dff1feefe69 2023-03-20 10:55:28,196 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c00186bd850f4540e39bc2caef12c922 in 1253ms, sequenceid=24, compaction requested=true 2023-03-20 10:55:28,196 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/58ba7b1576ba4eb2904c56b40ac703bc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/58ba7b1576ba4eb2904c56b40ac703bc 2023-03-20 10:55:28,196 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:28,196 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:28,196 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:28,199 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 979ad85edb884aad95bd4dff1feefe69 2023-03-20 10:55:28,199 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58ba7b1576ba4eb2904c56b40ac703bc 2023-03-20 10:55:28,199 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/979ad85edb884aad95bd4dff1feefe69, entries=1, sequenceid=24, filesize=5.0 K 2023-03-20 10:55:28,199 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/58ba7b1576ba4eb2904c56b40ac703bc, entries=1, sequenceid=24, filesize=5.0 K 2023-03-20 10:55:28,200 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3c8cd4be4947fdf88edb1fdf8adc4035 in 1257ms, sequenceid=24, compaction requested=true 2023-03-20 10:55:28,200 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e0ef86d3f8b59492e591fb6178d48b92 in 1257ms, sequenceid=24, compaction requested=true 2023-03-20 10:55:28,200 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:28,200 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:28,200 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:28,200 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:28,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:28,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:28,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:28,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-20 10:55:28,200 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-20 10:55:28,202 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,202 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:28,203 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,203 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:28,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-20 10:55:28,204 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-20 10:55:28,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3633d792[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:28,204 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,205 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,205 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-20 10:55:28,205 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-20 10:55:28,205 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:28,205 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,205 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:28,206 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,206 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-20 10:55:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:28,206 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:28,206 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-20 10:55:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:28,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-20 10:55:28,208 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-20 10:55:28,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:28,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:28,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-20 10:55:28,208 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:28,209 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,209 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:28,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,209 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:28,209 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:28,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:28,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:28,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,210 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-20 10:55:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-20 10:55:28,212 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:28,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-20 10:55:28,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-20 10:55:28,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:28,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:28,212 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-20 10:55:28,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:28,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:28,313 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:28,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:28,316 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:28,316 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): c00186bd850f4540e39bc2caef12c922/family1 is initiating major compaction (all files) 2023-03-20 10:55:28,316 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:28,317 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:28,317 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of c00186bd850f4540e39bc2caef12c922/family1 in testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:28,317 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d40a9f90167248feba5280090f8fefdc] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp, totalSize=26.7 K 2023-03-20 10:55:28,319 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting d0d25d6c489d4ca48325361a1b46fa13, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:28,320 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 71dc519219b8466f844ddce23e2ba862, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:28,321 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting c4b57356f6264512a450e9873de12bd4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:28,322 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3a3f1be0321048819f4959d5e5047023, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:28,323 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting d40a9f90167248feba5280090f8fefdc, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-20 10:55:28,337 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): c00186bd850f4540e39bc2caef12c922#family1#compaction#108 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:28,746 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del 2023-03-20 10:55:28,746 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del 2023-03-20 10:55:28,770 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a576aaf859a2436e81a9b9dadd6b0d73 2023-03-20 10:55:28,771 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/a576aaf859a2436e81a9b9dadd6b0d73 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/a576aaf859a2436e81a9b9dadd6b0d73 2023-03-20 10:55:28,776 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a576aaf859a2436e81a9b9dadd6b0d73 2023-03-20 10:55:28,777 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c00186bd850f4540e39bc2caef12c922/family1 of c00186bd850f4540e39bc2caef12c922 into a576aaf859a2436e81a9b9dadd6b0d73(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:28,777 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:28,777 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:28,777 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): c00186bd850f4540e39bc2caef12c922/family2 is initiating major compaction (all files) 2023-03-20 10:55:28,778 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:28,778 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:28,778 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of c00186bd850f4540e39bc2caef12c922/family2 in testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:28,778 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/026216ce9c85457180ac4084433ee228] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp, totalSize=25.4 K 2023-03-20 10:55:28,779 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 4d52e9fe9b92417088c18666c5facd2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:28,779 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 0ef7d64a2176478fa569dbdea08c79f7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:28,780 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting db04c9df44be43bab07be36df0261c69, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:28,780 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3ac497c49457427caf6a8e7cd5c105bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:28,781 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 026216ce9c85457180ac4084433ee228, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-20 10:55:28,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d40a9f90167248feba5280090f8fefdc] to archive 2023-03-20 10:55:28,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:28,804 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): c00186bd850f4540e39bc2caef12c922#family2#compaction#109 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:28,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d0d25d6c489d4ca48325361a1b46fa13 2023-03-20 10:55:28,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/71dc519219b8466f844ddce23e2ba862 2023-03-20 10:55:28,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/c4b57356f6264512a450e9873de12bd4 2023-03-20 10:55:28,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/3a3f1be0321048819f4959d5e5047023 2023-03-20 10:55:28,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d40a9f90167248feba5280090f8fefdc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d40a9f90167248feba5280090f8fefdc 2023-03-20 10:55:28,827 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del 2023-03-20 10:55:28,827 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del 2023-03-20 10:55:29,254 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bcb86a9740a40b2ac423c0ff54e364e 2023-03-20 10:55:29,256 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/2bcb86a9740a40b2ac423c0ff54e364e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/2bcb86a9740a40b2ac423c0ff54e364e 2023-03-20 10:55:29,262 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bcb86a9740a40b2ac423c0ff54e364e 2023-03-20 10:55:29,263 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c00186bd850f4540e39bc2caef12c922/family2 of c00186bd850f4540e39bc2caef12c922 into 2bcb86a9740a40b2ac423c0ff54e364e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:29,263 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:29,263 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:29,264 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): 3c8cd4be4947fdf88edb1fdf8adc4035/family1 is initiating major compaction (all files) 2023-03-20 10:55:29,264 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:29,264 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:29,264 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of 3c8cd4be4947fdf88edb1fdf8adc4035/family1 in testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:29,264 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/76aaf992f38343f3b1b5dabda784c946] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp, totalSize=26.7 K 2023-03-20 10:55:29,265 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting b770f2e4165844348c4edba8d880b2fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:29,266 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 1dcd99f49ca8459dba4bf3e28d495382, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:29,266 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting a8bc4c21ab8d461aa6a2a8b5a211c99b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:29,267 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting bc3d2821a41e45158b2cf509744dc526, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721308 2023-03-20 10:55:29,268 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 76aaf992f38343f3b1b5dabda784c946, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-20 10:55:29,281 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): 3c8cd4be4947fdf88edb1fdf8adc4035#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:29,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/026216ce9c85457180ac4084433ee228] to archive 2023-03-20 10:55:29,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:29,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/4d52e9fe9b92417088c18666c5facd2b 2023-03-20 10:55:29,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/0ef7d64a2176478fa569dbdea08c79f7 2023-03-20 10:55:29,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/db04c9df44be43bab07be36df0261c69 2023-03-20 10:55:29,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/3ac497c49457427caf6a8e7cd5c105bc 2023-03-20 10:55:29,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/026216ce9c85457180ac4084433ee228 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/026216ce9c85457180ac4084433ee228 2023-03-20 10:55:29,693 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del 2023-03-20 10:55:29,694 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del 2023-03-20 10:55:30,517 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01f59fcc47ff43c7b93d6c57e40e1711 2023-03-20 10:55:30,518 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/01f59fcc47ff43c7b93d6c57e40e1711 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/01f59fcc47ff43c7b93d6c57e40e1711 2023-03-20 10:55:30,522 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01f59fcc47ff43c7b93d6c57e40e1711 2023-03-20 10:55:30,523 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3c8cd4be4947fdf88edb1fdf8adc4035/family1 of 3c8cd4be4947fdf88edb1fdf8adc4035 into 01f59fcc47ff43c7b93d6c57e40e1711(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:30,523 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:30,523 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:30,523 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): 3c8cd4be4947fdf88edb1fdf8adc4035/family2 is initiating major compaction (all files) 2023-03-20 10:55:30,523 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:30,524 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:30,524 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of 3c8cd4be4947fdf88edb1fdf8adc4035/family2 in testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:30,524 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/979ad85edb884aad95bd4dff1feefe69] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp, totalSize=25.4 K 2023-03-20 10:55:30,524 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 99e1a51dbabf41009722cdb2477273c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:30,525 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 46c4378844f14aa8af546f3c7309c670, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:30,525 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting c4a18005f56f4e4e99df9afb595d587d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:30,525 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 12a74287105f40fa973d0144fbd31976, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721308 2023-03-20 10:55:30,525 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 979ad85edb884aad95bd4dff1feefe69, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-20 10:55:30,536 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): 3c8cd4be4947fdf88edb1fdf8adc4035#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:30,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/76aaf992f38343f3b1b5dabda784c946] to archive 2023-03-20 10:55:30,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:30,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/b770f2e4165844348c4edba8d880b2fb 2023-03-20 10:55:30,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/1dcd99f49ca8459dba4bf3e28d495382 2023-03-20 10:55:30,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/a8bc4c21ab8d461aa6a2a8b5a211c99b 2023-03-20 10:55:30,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/bc3d2821a41e45158b2cf509744dc526 2023-03-20 10:55:30,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/76aaf992f38343f3b1b5dabda784c946 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/76aaf992f38343f3b1b5dabda784c946 2023-03-20 10:55:30,947 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del 2023-03-20 10:55:30,947 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del 2023-03-20 10:55:31,790 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37891d830ef046e7803e401baafcc0be 2023-03-20 10:55:31,794 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/37891d830ef046e7803e401baafcc0be as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/37891d830ef046e7803e401baafcc0be 2023-03-20 10:55:31,805 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37891d830ef046e7803e401baafcc0be 2023-03-20 10:55:31,806 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3c8cd4be4947fdf88edb1fdf8adc4035/family2 of 3c8cd4be4947fdf88edb1fdf8adc4035 into 37891d830ef046e7803e401baafcc0be(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:31,807 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:31,807 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:31,807 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): e0ef86d3f8b59492e591fb6178d48b92/family1 is initiating major compaction (all files) 2023-03-20 10:55:31,807 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:31,807 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:31,808 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of e0ef86d3f8b59492e591fb6178d48b92/family1 in testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:31,808 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/5daa15359f3e4f698a48d40eb165fe43] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp, totalSize=26.7 K 2023-03-20 10:55:31,809 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 1c6edeb65fba49f2990a4aa1b11f9364, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716301 2023-03-20 10:55:31,810 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 0583b0cfc4e8452bb43edac5d5782662, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:31,811 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 21d8115aba044a059792bc558b24da8b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:31,812 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 7a5970f13ed04f62a91d8e921981fb6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:31,812 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 5daa15359f3e4f698a48d40eb165fe43, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-20 10:55:31,854 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): e0ef86d3f8b59492e591fb6178d48b92#family1#compaction#112 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:31,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/979ad85edb884aad95bd4dff1feefe69] to archive 2023-03-20 10:55:31,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:31,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/99e1a51dbabf41009722cdb2477273c7 2023-03-20 10:55:31,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/46c4378844f14aa8af546f3c7309c670 2023-03-20 10:55:31,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/c4a18005f56f4e4e99df9afb595d587d 2023-03-20 10:55:31,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/12a74287105f40fa973d0144fbd31976 2023-03-20 10:55:31,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/979ad85edb884aad95bd4dff1feefe69 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/979ad85edb884aad95bd4dff1feefe69 2023-03-20 10:55:32,278 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del 2023-03-20 10:55:32,278 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del 2023-03-20 10:55:33,117 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00059b7d383d483a85bab345ebd48b6b 2023-03-20 10:55:33,118 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/00059b7d383d483a85bab345ebd48b6b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/00059b7d383d483a85bab345ebd48b6b 2023-03-20 10:55:33,125 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00059b7d383d483a85bab345ebd48b6b 2023-03-20 10:55:33,126 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e0ef86d3f8b59492e591fb6178d48b92/family1 of e0ef86d3f8b59492e591fb6178d48b92 into 00059b7d383d483a85bab345ebd48b6b(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:33,127 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:33,127 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:33,127 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): e0ef86d3f8b59492e591fb6178d48b92/family2 is initiating major compaction (all files) 2023-03-20 10:55:33,127 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:33,127 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:33,127 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of e0ef86d3f8b59492e591fb6178d48b92/family2 in testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:33,127 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/58ba7b1576ba4eb2904c56b40ac703bc] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp, totalSize=25.4 K 2023-03-20 10:55:33,128 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting ec5cbb67fa6c46c28a7336685398e8a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716301 2023-03-20 10:55:33,128 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting e1d079c267a640e3961b321f446bc7bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:33,129 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 9bfe3c70c8534469bd6f91dbe095148c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:33,129 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 5472a8e7a2c548ceac231c2b5bbdbf3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:33,130 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 58ba7b1576ba4eb2904c56b40ac703bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-20 10:55:33,149 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): e0ef86d3f8b59492e591fb6178d48b92#family2#compaction#113 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:33,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/5daa15359f3e4f698a48d40eb165fe43] to archive 2023-03-20 10:55:33,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:33,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/1c6edeb65fba49f2990a4aa1b11f9364 2023-03-20 10:55:33,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/0583b0cfc4e8452bb43edac5d5782662 2023-03-20 10:55:33,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/21d8115aba044a059792bc558b24da8b 2023-03-20 10:55:33,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a5970f13ed04f62a91d8e921981fb6e 2023-03-20 10:55:33,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/5daa15359f3e4f698a48d40eb165fe43 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/5daa15359f3e4f698a48d40eb165fe43 2023-03-20 10:55:33,569 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del 2023-03-20 10:55:33,569 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del 2023-03-20 10:55:33,985 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81fcf36e648f4ac0b902c727336011b2 2023-03-20 10:55:33,985 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/81fcf36e648f4ac0b902c727336011b2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/81fcf36e648f4ac0b902c727336011b2 2023-03-20 10:55:33,989 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81fcf36e648f4ac0b902c727336011b2 2023-03-20 10:55:33,990 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e0ef86d3f8b59492e591fb6178d48b92/family2 of e0ef86d3f8b59492e591fb6178d48b92 into 81fcf36e648f4ac0b902c727336011b2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:33,990 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:33,995 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:33,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/58ba7b1576ba4eb2904c56b40ac703bc] to archive 2023-03-20 10:55:33,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:34,000 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:34,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/ec5cbb67fa6c46c28a7336685398e8a4 2023-03-20 10:55:34,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/e1d079c267a640e3961b321f446bc7bf 2023-03-20 10:55:34,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/9bfe3c70c8534469bd6f91dbe095148c 2023-03-20 10:55:34,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/5472a8e7a2c548ceac231c2b5bbdbf3e 2023-03-20 10:55:34,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/58ba7b1576ba4eb2904c56b40ac703bc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/58ba7b1576ba4eb2904c56b40ac703bc 2023-03-20 10:55:34,010 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:34,012 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:34,022 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-20 10:55:34,069 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-20 10:55:34,073 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del 2023-03-20 10:55:34,078 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del 2023-03-20 10:55:34,086 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del 2023-03-20 10:55:34,086 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:34,086 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(139): Connect 0x534804c5 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:34,090 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ed4688, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:34,091 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:34,091 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:34,094 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:34,585 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320804d075e0c11448fac835c5d2f593ec8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320804d075e0c11448fac835c5d2f593ec8 2023-03-20 10:55:34,585 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:34,597 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:34,601 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:34,608 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:55:34,610 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:55:34,620 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/f854d15f81cd415280ce8aa0f0f834ce first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-20 10:55:34,620 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/f854d15f81cd415280ce8aa0f0f834ce}] 2023-03-20 10:55:34,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/f854d15f81cd415280ce8aa0f0f834ce for inclusion in e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:34,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-20 10:55:34,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-20 10:55:34,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:34,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/f854d15f81cd415280ce8aa0f0f834ce to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__eq60u9n3ph7icvljdvusjp8lk6gkkr5d56v8gq01h5iif6cc8u0thicn31c6jht/family1/f854d15f81cd415280ce8aa0f0f834ce 2023-03-20 10:55:34,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__eq60u9n3ph7icvljdvusjp8lk6gkkr5d56v8gq01h5iif6cc8u0thicn31c6jht/family1/f854d15f81cd415280ce8aa0f0f834ce as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_ 2023-03-20 10:55:34,632 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__eq60u9n3ph7icvljdvusjp8lk6gkkr5d56v8gq01h5iif6cc8u0thicn31c6jht/family1/f854d15f81cd415280ce8aa0f0f834ce into e0ef86d3f8b59492e591fb6178d48b92/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_ - updating store file list. 2023-03-20 10:55:34,636 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_ into e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:34,636 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__eq60u9n3ph7icvljdvusjp8lk6gkkr5d56v8gq01h5iif6cc8u0thicn31c6jht/family1/f854d15f81cd415280ce8aa0f0f834ce into e0ef86d3f8b59492e591fb6178d48b92/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_) 2023-03-20 10:55:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__eq60u9n3ph7icvljdvusjp8lk6gkkr5d56v8gq01h5iif6cc8u0thicn31c6jht/family1/f854d15f81cd415280ce8aa0f0f834ce 2023-03-20 10:55:34,638 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:34,639 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:34,640 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 2023-03-20 10:55:34,641 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c 2023-03-20 10:55:34,642 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a 2023-03-20 10:55:34,643 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 2023-03-20 10:55:34,643 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-20 10:55:34,643 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320' 2023-03-20 10:55:34,643 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:34,979 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320ae4e255c42c34ac191764d59654e1b72 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ae4e255c42c34ac191764d59654e1b72 2023-03-20 10:55:34,979 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320ac7dfdc1ee1f455dbd81289045ed673b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ac7dfdc1ee1f455dbd81289045ed673b 2023-03-20 10:55:34,980 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:34,980 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:35,008 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/fa9996dc5fd64b1b85f58b8f4bffe850 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-20 10:55:35,011 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/fa9996dc5fd64b1b85f58b8f4bffe850}] 2023-03-20 10:55:35,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/fa9996dc5fd64b1b85f58b8f4bffe850 for inclusion in c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:35,014 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/718844a05933445f94497ebef0c4bfa4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-20 10:55:35,015 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/718844a05933445f94497ebef0c4bfa4}] 2023-03-20 10:55:35,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-20 10:55:35,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-20 10:55:35,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/fa9996dc5fd64b1b85f58b8f4bffe850 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__at2k629sfpbb8s012ct0sourhe48jh6ru5jucatvupe6vrc2r1h1i6beronkhr9a/family1/fa9996dc5fd64b1b85f58b8f4bffe850 2023-03-20 10:55:35,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/718844a05933445f94497ebef0c4bfa4 for inclusion in 3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-20 10:55:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last=1 2023-03-20 10:55:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:35,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__at2k629sfpbb8s012ct0sourhe48jh6ru5jucatvupe6vrc2r1h1i6beronkhr9a/family1/fa9996dc5fd64b1b85f58b8f4bffe850 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_ 2023-03-20 10:55:35,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/718844a05933445f94497ebef0c4bfa4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__8heee1noq7ing2e3baedlhk7q5o7883kji0sv427i7jot7hbimcbcv02b9ehf4e/family1/718844a05933445f94497ebef0c4bfa4 2023-03-20 10:55:35,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__at2k629sfpbb8s012ct0sourhe48jh6ru5jucatvupe6vrc2r1h1i6beronkhr9a/family1/fa9996dc5fd64b1b85f58b8f4bffe850 into c00186bd850f4540e39bc2caef12c922/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_ - updating store file list. 2023-03-20 10:55:35,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__8heee1noq7ing2e3baedlhk7q5o7883kji0sv427i7jot7hbimcbcv02b9ehf4e/family1/718844a05933445f94497ebef0c4bfa4 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_ 2023-03-20 10:55:35,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__8heee1noq7ing2e3baedlhk7q5o7883kji0sv427i7jot7hbimcbcv02b9ehf4e/family1/718844a05933445f94497ebef0c4bfa4 into 3c8cd4be4947fdf88edb1fdf8adc4035/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_ - updating store file list. 2023-03-20 10:55:35,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_ into c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:35,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__at2k629sfpbb8s012ct0sourhe48jh6ru5jucatvupe6vrc2r1h1i6beronkhr9a/family1/fa9996dc5fd64b1b85f58b8f4bffe850 into c00186bd850f4540e39bc2caef12c922/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_) 2023-03-20 10:55:35,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__at2k629sfpbb8s012ct0sourhe48jh6ru5jucatvupe6vrc2r1h1i6beronkhr9a/family1/fa9996dc5fd64b1b85f58b8f4bffe850 2023-03-20 10:55:35,039 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:35,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_ into 3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:35,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__8heee1noq7ing2e3baedlhk7q5o7883kji0sv427i7jot7hbimcbcv02b9ehf4e/family1/718844a05933445f94497ebef0c4bfa4 into 3c8cd4be4947fdf88edb1fdf8adc4035/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_) 2023-03-20 10:55:35,040 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:35,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__8heee1noq7ing2e3baedlhk7q5o7883kji0sv427i7jot7hbimcbcv02b9ehf4e/family1/718844a05933445f94497ebef0c4bfa4 2023-03-20 10:55:35,041 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb 2023-03-20 10:55:35,042 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:35,043 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da 2023-03-20 10:55:35,043 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:35,044 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad 2023-03-20 10:55:35,044 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 2023-03-20 10:55:35,045 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa 2023-03-20 10:55:35,045 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 2023-03-20 10:55:35,045 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-20 10:55:35,045 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320' 2023-03-20 10:55:35,046 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:35,046 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c 2023-03-20 10:55:35,047 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 2023-03-20 10:55:35,047 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-20 10:55:35,047 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320' 2023-03-20 10:55:35,047 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:35,048 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:35,048 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:35,048 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del] 2023-03-20 10:55:35,048 DEBUG [Listener at localhost.localdomain/43657] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:35,049 DEBUG [Listener at localhost.localdomain/43657] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320d56dd1be8eeb4306b448bcca3e97d6de_del 2023-03-20 10:55:35,049 INFO [Listener at localhost.localdomain/43657] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-20 10:55:35,049 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del] 2023-03-20 10:55:35,050 DEBUG [Listener at localhost.localdomain/43657] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:35,051 DEBUG [Listener at localhost.localdomain/43657] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303203f1ed4414825485b981ad942750c5020_del 2023-03-20 10:55:35,051 INFO [Listener at localhost.localdomain/43657] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-20 10:55:35,051 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del] 2023-03-20 10:55:35,051 DEBUG [Listener at localhost.localdomain/43657] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:35,052 DEBUG [Listener at localhost.localdomain/43657] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320c6ba1baf82634511bbf32e5aeba36cc3_del 2023-03-20 10:55:35,053 INFO [Listener at localhost.localdomain/43657] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-20 10:55:35,055 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:35,058 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:35,062 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:35,064 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:35,069 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-20 10:55:35,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-03-20 10:55:35,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-20 10:55:35,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-20 10:55:35,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309735073"}]},"ts":"1679309735073"} 2023-03-20 10:55:35,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-20 10:55:35,075 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-20 10:55:35,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, UNASSIGN}] 2023-03-20 10:55:35,077 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, UNASSIGN 2023-03-20 10:55:35,077 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, UNASSIGN 2023-03-20 10:55:35,077 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, UNASSIGN 2023-03-20 10:55:35,078 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e0ef86d3f8b59492e591fb6178d48b92, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:35,078 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=3c8cd4be4947fdf88edb1fdf8adc4035, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:35,078 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c00186bd850f4540e39bc2caef12c922, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:35,078 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309735078"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309735078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309735078"}]},"ts":"1679309735078"} 2023-03-20 10:55:35,078 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309735078"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309735078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309735078"}]},"ts":"1679309735078"} 2023-03-20 10:55:35,078 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309735078"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309735078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309735078"}]},"ts":"1679309735078"} 2023-03-20 10:55:35,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure e0ef86d3f8b59492e591fb6178d48b92, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:35,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure c00186bd850f4540e39bc2caef12c922, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:35,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 3c8cd4be4947fdf88edb1fdf8adc4035, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:35,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-20 10:55:35,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e0ef86d3f8b59492e591fb6178d48b92, disabling compactions & flushes 2023-03-20 10:55:35,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:35,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. after waiting 0 ms 2023-03-20 10:55:35,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:35,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-20 10:55:35,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:35,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:35,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:35,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3c8cd4be4947fdf88edb1fdf8adc4035, disabling compactions & flushes 2023-03-20 10:55:35,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. after waiting 0 ms 2023-03-20 10:55:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:35,236 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e0ef86d3f8b59492e591fb6178d48b92, regionState=CLOSED 2023-03-20 10:55:35,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309735236"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309735236"}]},"ts":"1679309735236"} 2023-03-20 10:55:35,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-03-20 10:55:35,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure e0ef86d3f8b59492e591fb6178d48b92, server=jenkins-hbase20.apache.org,44189,1679309623230 in 158 msec 2023-03-20 10:55:35,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, UNASSIGN in 163 msec 2023-03-20 10:55:35,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-20 10:55:35,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:35,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:35,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:35,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:35,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c00186bd850f4540e39bc2caef12c922, disabling compactions & flushes 2023-03-20 10:55:35,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:35,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:35,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. after waiting 0 ms 2023-03-20 10:55:35,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:35,242 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=3c8cd4be4947fdf88edb1fdf8adc4035, regionState=CLOSED 2023-03-20 10:55:35,242 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309735242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309735242"}]},"ts":"1679309735242"} 2023-03-20 10:55:35,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-03-20 10:55:35,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 3c8cd4be4947fdf88edb1fdf8adc4035, server=jenkins-hbase20.apache.org,44189,1679309623230 in 164 msec 2023-03-20 10:55:35,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, UNASSIGN in 170 msec 2023-03-20 10:55:35,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-20 10:55:35,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:35,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:35,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:35,248 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c00186bd850f4540e39bc2caef12c922, regionState=CLOSED 2023-03-20 10:55:35,248 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309735248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309735248"}]},"ts":"1679309735248"} 2023-03-20 10:55:35,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-03-20 10:55:35,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure c00186bd850f4540e39bc2caef12c922, server=jenkins-hbase20.apache.org,44189,1679309623230 in 170 msec 2023-03-20 10:55:35,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-03-20 10:55:35,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, UNASSIGN in 175 msec 2023-03-20 10:55:35,252 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309735252"}]},"ts":"1679309735252"} 2023-03-20 10:55:35,254 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-20 10:55:35,255 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-20 10:55:35,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 186 msec 2023-03-20 10:55:35,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-20 10:55:35,375 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-20 10:55:35,387 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:35,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:35,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679309735388 (current time:1679309735388). 2023-03-20 10:55:35,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-20 10:55:35,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] zookeeper.ReadOnlyZKClient(139): Connect 0x7f0150d9 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:35,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d3723b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:35,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:35,400 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:35,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f0150d9 to 127.0.0.1:62837 2023-03-20 10:55:35,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:35,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-20 10:55:35,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:35,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-20 10:55:35,405 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-20 10:55:35,405 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679310335405 2023-03-20 10:55:35,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:35,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1679309722752-1679309735387 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-20 10:55:35,406 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:35,406 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-20 10:55:35,506 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:35,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:35,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:35,507 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-20 10:55:35,707 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:35,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:35,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:35,710 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-20 10:55:35,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-20 10:55:35,813 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/00059b7d383d483a85bab345ebd48b6b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_] hfiles 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/00059b7d383d483a85bab345ebd48b6b 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_ 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/a576aaf859a2436e81a9b9dadd6b0d73] hfiles 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/01f59fcc47ff43c7b93d6c57e40e1711, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_] hfiles 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_ 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/01f59fcc47ff43c7b93d6c57e40e1711 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/a576aaf859a2436e81a9b9dadd6b0d73 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ac7dfdc1ee1f455dbd81289045ed673b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320804d075e0c11448fac835c5d2f593ec8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ae4e255c42c34ac191764d59654e1b72] hfiles 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_ 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ac7dfdc1ee1f455dbd81289045ed673b 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320804d075e0c11448fac835c5d2f593ec8 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ae4e255c42c34ac191764d59654e1b72 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/81fcf36e648f4ac0b902c727336011b2] hfiles 2023-03-20 10:55:35,816 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/81fcf36e648f4ac0b902c727336011b2 2023-03-20 10:55:35,817 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/37891d830ef046e7803e401baafcc0be] hfiles 2023-03-20 10:55:35,817 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/2bcb86a9740a40b2ac423c0ff54e364e] hfiles 2023-03-20 10:55:35,817 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/37891d830ef046e7803e401baafcc0be 2023-03-20 10:55:35,817 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/2bcb86a9740a40b2ac423c0ff54e364e 2023-03-20 10:55:35,823 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032011a6e2b982484f4786dffa9a23d8c738, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032046c0f96066aa46d0b372b51a1ca9dd7e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320af884cfd55d245a4b5979c2a14f93464, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d268597120074a94819db3e1024a663d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303201ea3feeb8a7548218ff749ab5e007b60, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320ae6c6bd8b18246ceaf8bf2d018d787b0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c25d91f7c884446787f0f95745d5d990, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c927ee77e7964836a7f9a3fbcd394eed, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032022857f40302e49978009dba4a600fc10, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032078c039e8283a4f8d9a2370b4a2934983, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320844784c5c05749ed965bd7967a75075b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320c30c62dd1c924654afbae160d098e5c1, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del] hfiles 2023-03-20 10:55:35,823 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032011a6e2b982484f4786dffa9a23d8c738 2023-03-20 10:55:35,823 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023032046c0f96066aa46d0b372b51a1ca9dd7e 2023-03-20 10:55:35,823 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320af884cfd55d245a4b5979c2a14f93464 2023-03-20 10:55:35,823 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d268597120074a94819db3e1024a663d 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303201ea3feeb8a7548218ff749ab5e007b60 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320ae6c6bd8b18246ceaf8bf2d018d787b0 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c25d91f7c884446787f0f95745d5d990 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320c927ee77e7964836a7f9a3fbcd394eed 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032022857f40302e49978009dba4a600fc10 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032078c039e8283a4f8d9a2370b4a2934983 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320844784c5c05749ed965bd7967a75075b 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320c30c62dd1c924654afbae160d098e5c1 2023-03-20 10:55:35,824 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del 2023-03-20 10:55:36,010 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:36,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:36,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:36,011 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-20 10:55:36,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-20 10:55:36,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:36,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:36,512 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:36,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:36,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-20 10:55:36,514 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-20 10:55:36,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679309722752-1679309735387 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:37,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1679309722752-1679309735387 of table testCompactionWithHFileLink completed 2023-03-20 10:55:37,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:37,482 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:37,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1679309722752-1679309735387 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679309735405Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1679309735812 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1679309722752-1679309735387 at 1679309736229 (+417 ms)Loading Region manifests for hbase-failsafe-snaptb-1679309722752-1679309735387 at 1679309736229Writing data manifest for hbase-failsafe-snaptb-1679309722752-1679309735387 at 1679309736232 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1679309722752-1679309735387 at 1679309736642 (+410 ms)Snapshot hbase-failsafe-snaptb-1679309722752-1679309735387 of table testCompactionWithHFileLink completed at 1679309737481 (+839 ms) 2023-03-20 10:55:37,483 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-20 10:55:37,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0800 sec 2023-03-20 10:55:37,515 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-20 10:55:37,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-20 10:55:37,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1679309722752-1679309735387 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-20 10:55:37,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679309722752" table: "testCompactionWithHFileLink" creation_time: 1679309722761 type: FLUSH version: 2 ttl: 0 ) 2023-03-20 10:55:37,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1679309722752 as table=testCompactionWithHFileLink 2023-03-20 10:55:37,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-20 10:55:37,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-20 10:55:37,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-20 10:55:37,970 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-20 10:55:37,971 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-20 10:55:37,971 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-20 10:55:37,972 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-20 10:55:37,976 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1679309722752" table: "testCompactionWithHFileLink" creation_time: 1679309722761 type: FLUSH version: 2 ttl: 0 2023-03-20 10:55:37,977 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink 2023-03-20 10:55:37,982 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-20 10:55:37,986 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ac7dfdc1ee1f455dbd81289045ed673b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320ac7dfdc1ee1f455dbd81289045ed673b 2023-03-20 10:55:37,987 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320804d075e0c11448fac835c5d2f593ec8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320804d075e0c11448fac835c5d2f593ec8 2023-03-20 10:55:37,989 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ae4e255c42c34ac191764d59654e1b72 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230320ae4e255c42c34ac191764d59654e1b72 2023-03-20 10:55:37,989 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:37,993 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:37,996 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,000 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,006 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,010 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,018 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,022 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,026 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,034 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,038 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,043 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 of snapshot=snaptb-1679309722752 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-20 10:55:38,048 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230320455a2fea730044fd8fcf807ed3fa4214_del 2023-03-20 10:55:38,049 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230320d167e043f4c54f38be489a6c0e0240b9_del 2023-03-20 10:55:38,050 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230320e5888be831db49e48bad1e993402a94d_del 2023-03-20 10:55:38,050 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,050 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,050 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,053 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/a576aaf859a2436e81a9b9dadd6b0d73 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/a576aaf859a2436e81a9b9dadd6b0d73 2023-03-20 10:55:38,053 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/9bc7ac2b44a543828f597dba0eb5091a_SeqId_29_ 2023-03-20 10:55:38,054 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/5f874a5b507643ff8d993f40d3da35da_SeqId_29_ 2023-03-20 10:55:38,054 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d0d25d6c489d4ca48325361a1b46fa13 of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,054 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/00059b7d383d483a85bab345ebd48b6b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/00059b7d383d483a85bab345ebd48b6b 2023-03-20 10:55:38,054 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1c6edeb65fba49f2990a4aa1b11f9364 of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,056 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 71dc519219b8466f844ddce23e2ba862 of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,056 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0583b0cfc4e8452bb43edac5d5782662 of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,057 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/01f59fcc47ff43c7b93d6c57e40e1711 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/01f59fcc47ff43c7b93d6c57e40e1711 2023-03-20 10:55:38,058 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/ba90351d7ef04de587bfc261dfc88e81_SeqId_29_ 2023-03-20 10:55:38,059 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b770f2e4165844348c4edba8d880b2fb of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,059 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 21d8115aba044a059792bc558b24da8b of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,060 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4b57356f6264512a450e9873de12bd4 of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,062 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1dcd99f49ca8459dba4bf3e28d495382 of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,062 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7a5970f13ed04f62a91d8e921981fb6e of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,063 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a3f1be0321048819f4959d5e5047023 of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,064 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a8bc4c21ab8d461aa6a2a8b5a211c99b of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,066 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/81fcf36e648f4ac0b902c727336011b2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/81fcf36e648f4ac0b902c727336011b2 2023-03-20 10:55:38,066 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ec5cbb67fa6c46c28a7336685398e8a4 of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,067 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/2bcb86a9740a40b2ac423c0ff54e364e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/2bcb86a9740a40b2ac423c0ff54e364e 2023-03-20 10:55:38,068 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bc3d2821a41e45158b2cf509744dc526 of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,068 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4d52e9fe9b92417088c18666c5facd2b of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,070 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e1d079c267a640e3961b321f446bc7bf of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,072 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0ef7d64a2176478fa569dbdea08c79f7 of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,074 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9bfe3c70c8534469bd6f91dbe095148c of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,074 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/37891d830ef046e7803e401baafcc0be to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/37891d830ef046e7803e401baafcc0be 2023-03-20 10:55:38,074 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 99e1a51dbabf41009722cdb2477273c7 of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,078 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink db04c9df44be43bab07be36df0261c69 of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,079 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 46c4378844f14aa8af546f3c7309c670 of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,079 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5472a8e7a2c548ceac231c2b5bbdbf3e of snapshot=snaptb-1679309722752 to region=e0ef86d3f8b59492e591fb6178d48b92 table=testCompactionWithHFileLink 2023-03-20 10:55:38,081 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3ac497c49457427caf6a8e7cd5c105bc of snapshot=snaptb-1679309722752 to region=c00186bd850f4540e39bc2caef12c922 table=testCompactionWithHFileLink 2023-03-20 10:55:38,083 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4a18005f56f4e4e99df9afb595d587d of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,085 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 12a74287105f40fa973d0144fbd31976 of snapshot=snaptb-1679309722752 to region=3c8cd4be4947fdf88edb1fdf8adc4035 table=testCompactionWithHFileLink 2023-03-20 10:55:38,088 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1679309722752" table: "testCompactionWithHFileLink" creation_time: 1679309722761 type: FLUSH version: 2 ttl: 0 2023-03-20 10:55:38,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679309738089"}]},"ts":"9223372036854775807"} 2023-03-20 10:55:38,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679309738089"}]},"ts":"9223372036854775807"} 2023-03-20 10:55:38,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679309738089"}]},"ts":"9223372036854775807"} 2023-03-20 10:55:38,091 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-20 10:55:38,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c8cd4be4947fdf88edb1fdf8adc4035, NAME => 'testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c00186bd850f4540e39bc2caef12c922, NAME => 'testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => e0ef86d3f8b59492e591fb6178d48b92, NAME => 'testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.', STARTKEY => '2', ENDKEY => ''}] 2023-03-20 10:55:38,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309738090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309738090"}]},"ts":"1679309738090"} 2023-03-20 10:55:38,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309738090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309738090"}]},"ts":"1679309738090"} 2023-03-20 10:55:38,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309738090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309738090"}]},"ts":"1679309738090"} 2023-03-20 10:55:38,092 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-20 10:55:38,092 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-20 10:55:38,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 3c8cd4be4947fdf88edb1fdf8adc4035, NAME => 'testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c00186bd850f4540e39bc2caef12c922, NAME => 'testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => e0ef86d3f8b59492e591fb6178d48b92, NAME => 'testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.', STARTKEY => '2', ENDKEY => ''}] 2023-03-20 10:55:38,093 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1679309722752 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-20 10:55:38,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679309722752" table: "testCompactionWithHFileLink" creation_time: 1679309722761 type: FLUSH version: 2 ttl: 0 ) in 542 msec 2023-03-20 10:55:38,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-20 10:55:38,166 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-20 10:55:38,166 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:38,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1679309722752-1679309735387" 2023-03-20 10:55:38,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1679309722752-1679309735387 2023-03-20 10:55:38,173 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-20 10:55:38,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-03-20 10:55:38,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-20 10:55:38,184 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-20 10:55:38,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-20 10:55:38,184 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309738184"}]},"ts":"1679309738184"} 2023-03-20 10:55:38,185 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-20 10:55:38,187 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-20 10:55:38,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN}] 2023-03-20 10:55:38,189 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN 2023-03-20 10:55:38,189 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN 2023-03-20 10:55:38,189 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN 2023-03-20 10:55:38,189 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-20 10:55:38,189 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-20 10:55:38,189 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-20 10:55:38,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-20 10:55:38,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c00186bd850f4540e39bc2caef12c922, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:38,341 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e0ef86d3f8b59492e591fb6178d48b92, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:38,341 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309738341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309738341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309738341"}]},"ts":"1679309738341"} 2023-03-20 10:55:38,342 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309738341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309738341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309738341"}]},"ts":"1679309738341"} 2023-03-20 10:55:38,341 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=3c8cd4be4947fdf88edb1fdf8adc4035, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:38,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309738341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309738341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309738341"}]},"ts":"1679309738341"} 2023-03-20 10:55:38,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure c00186bd850f4540e39bc2caef12c922, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:38,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure e0ef86d3f8b59492e591fb6178d48b92, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:38,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 3c8cd4be4947fdf88edb1fdf8adc4035, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:38,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-20 10:55:38,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:38,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0ef86d3f8b59492e591fb6178d48b92, NAME => 'testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.', STARTKEY => '2', ENDKEY => ''} 2023-03-20 10:55:38,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:38,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,504 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,506 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:38,506 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:38,507 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0ef86d3f8b59492e591fb6178d48b92 columnFamilyName family1 2023-03-20 10:55:38,525 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-0583b0cfc4e8452bb43edac5d5782662 2023-03-20 10:55:38,532 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-1c6edeb65fba49f2990a4aa1b11f9364 2023-03-20 10:55:38,539 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-21d8115aba044a059792bc558b24da8b 2023-03-20 10:55:38,545 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-7a5970f13ed04f62a91d8e921981fb6e 2023-03-20 10:55:38,546 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(310): Store=e0ef86d3f8b59492e591fb6178d48b92/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:38,546 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,547 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2 2023-03-20 10:55:38,547 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2 2023-03-20 10:55:38,547 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0ef86d3f8b59492e591fb6178d48b92 columnFamilyName family2 2023-03-20 10:55:38,557 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-5472a8e7a2c548ceac231c2b5bbdbf3e 2023-03-20 10:55:38,564 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-9bfe3c70c8534469bd6f91dbe095148c 2023-03-20 10:55:38,572 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-e1d079c267a640e3961b321f446bc7bf 2023-03-20 10:55:38,582 DEBUG [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-ec5cbb67fa6c46c28a7336685398e8a4 2023-03-20 10:55:38,582 INFO [StoreOpener-e0ef86d3f8b59492e591fb6178d48b92-1] regionserver.HStore(310): Store=e0ef86d3f8b59492e591fb6178d48b92/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:38,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:38,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:55:38,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e0ef86d3f8b59492e591fb6178d48b92; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61594453, jitterRate=-0.08217112720012665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:38,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:38,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92., pid=102, masterSystemTime=1679309738495 2023-03-20 10:55:38,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:55:38,594 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-20 10:55:38,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-20 10:55:38,594 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-20 10:55:38,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:38,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:38,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:38,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c00186bd850f4540e39bc2caef12c922, NAME => 'testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.', STARTKEY => '1', ENDKEY => '2'} 2023-03-20 10:55:38,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e0ef86d3f8b59492e591fb6178d48b92, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:38,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309738599"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309738599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309738599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309738599"}]},"ts":"1679309738599"} 2023-03-20 10:55:38,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:38,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,600 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,601 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-20 10:55:38,601 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1912): e0ef86d3f8b59492e591fb6178d48b92/family2 is initiating minor compaction (all files) 2023-03-20 10:55:38,601 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegion(2259): Starting compaction of e0ef86d3f8b59492e591fb6178d48b92/family2 in testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:38,601 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-ec5cbb67fa6c46c28a7336685398e8a4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-e1d079c267a640e3961b321f446bc7bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-9bfe3c70c8534469bd6f91dbe095148c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-5472a8e7a2c548ceac231c2b5bbdbf3e] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp, totalSize=20.4 K 2023-03-20 10:55:38,601 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:38,602 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:38,602 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c00186bd850f4540e39bc2caef12c922 columnFamilyName family1 2023-03-20 10:55:38,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-03-20 10:55:38,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure e0ef86d3f8b59492e591fb6178d48b92, server=jenkins-hbase20.apache.org,44189,1679309623230 in 256 msec 2023-03-20 10:55:38,602 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-ec5cbb67fa6c46c28a7336685398e8a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716301 2023-03-20 10:55:38,603 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-20 10:55:38,603 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1912): e0ef86d3f8b59492e591fb6178d48b92/family1 is initiating minor compaction (all files) 2023-03-20 10:55:38,603 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e0ef86d3f8b59492e591fb6178d48b92/family1 in testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:55:38,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e0ef86d3f8b59492e591fb6178d48b92, ASSIGN in 415 msec 2023-03-20 10:55:38,603 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-e1d079c267a640e3961b321f446bc7bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:38,603 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-1c6edeb65fba49f2990a4aa1b11f9364, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-0583b0cfc4e8452bb43edac5d5782662, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-21d8115aba044a059792bc558b24da8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-7a5970f13ed04f62a91d8e921981fb6e] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp, totalSize=21.6 K 2023-03-20 10:55:38,604 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-1c6edeb65fba49f2990a4aa1b11f9364, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716301 2023-03-20 10:55:38,604 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-9bfe3c70c8534469bd6f91dbe095148c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:38,605 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-0583b0cfc4e8452bb43edac5d5782662, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:38,605 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-5472a8e7a2c548ceac231c2b5bbdbf3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:38,605 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-21d8115aba044a059792bc558b24da8b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:38,606 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-7a5970f13ed04f62a91d8e921981fb6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:38,618 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3a3f1be0321048819f4959d5e5047023 2023-03-20 10:55:38,626 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-71dc519219b8466f844ddce23e2ba862 2023-03-20 10:55:38,636 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-c4b57356f6264512a450e9873de12bd4 2023-03-20 10:55:38,646 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): e0ef86d3f8b59492e591fb6178d48b92#family1#compaction#114 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:38,654 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-d0d25d6c489d4ca48325361a1b46fa13 2023-03-20 10:55:38,654 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(310): Store=c00186bd850f4540e39bc2caef12c922/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:38,654 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,655 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2 2023-03-20 10:55:38,655 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2 2023-03-20 10:55:38,655 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c00186bd850f4540e39bc2caef12c922 columnFamilyName family2 2023-03-20 10:55:38,658 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] throttle.PressureAwareThroughputController(145): e0ef86d3f8b59492e591fb6178d48b92#family2#compaction#115 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:38,668 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-0ef7d64a2176478fa569dbdea08c79f7 2023-03-20 10:55:38,676 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3ac497c49457427caf6a8e7cd5c105bc 2023-03-20 10:55:38,680 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-4d52e9fe9b92417088c18666c5facd2b 2023-03-20 10:55:38,685 DEBUG [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-db04c9df44be43bab07be36df0261c69 2023-03-20 10:55:38,685 INFO [StoreOpener-c00186bd850f4540e39bc2caef12c922-1] regionserver.HStore(310): Store=c00186bd850f4540e39bc2caef12c922/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:38,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:38,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:55:38,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c00186bd850f4540e39bc2caef12c922; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63635972, jitterRate=-0.051750123500823975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:38,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922., pid=101, masterSystemTime=1679309738495 2023-03-20 10:55:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-20 10:55:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-20 10:55:38,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:38,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:38,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c8cd4be4947fdf88edb1fdf8adc4035, NAME => 'testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.', STARTKEY => '', ENDKEY => '1'} 2023-03-20 10:55:38,692 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c00186bd850f4540e39bc2caef12c922, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,692 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309738692"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309738692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309738692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309738692"}]},"ts":"1679309738692"} 2023-03-20 10:55:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,693 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,694 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:38,694 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:38,694 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8cd4be4947fdf88edb1fdf8adc4035 columnFamilyName family1 2023-03-20 10:55:38,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-03-20 10:55:38,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure c00186bd850f4540e39bc2caef12c922, server=jenkins-hbase20.apache.org,44189,1679309623230 in 350 msec 2023-03-20 10:55:38,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c00186bd850f4540e39bc2caef12c922, ASSIGN in 508 msec 2023-03-20 10:55:38,701 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-1dcd99f49ca8459dba4bf3e28d495382 2023-03-20 10:55:38,706 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-a8bc4c21ab8d461aa6a2a8b5a211c99b 2023-03-20 10:55:38,712 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-b770f2e4165844348c4edba8d880b2fb 2023-03-20 10:55:38,718 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-bc3d2821a41e45158b2cf509744dc526 2023-03-20 10:55:38,718 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(310): Store=3c8cd4be4947fdf88edb1fdf8adc4035/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:38,718 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,719 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2 2023-03-20 10:55:38,719 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2 2023-03-20 10:55:38,720 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8cd4be4947fdf88edb1fdf8adc4035 columnFamilyName family2 2023-03-20 10:55:38,728 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-12a74287105f40fa973d0144fbd31976 2023-03-20 10:55:38,733 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-46c4378844f14aa8af546f3c7309c670 2023-03-20 10:55:38,740 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-99e1a51dbabf41009722cdb2477273c7 2023-03-20 10:55:38,750 DEBUG [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-c4a18005f56f4e4e99df9afb595d587d 2023-03-20 10:55:38,750 INFO [StoreOpener-3c8cd4be4947fdf88edb1fdf8adc4035-1] regionserver.HStore(310): Store=3c8cd4be4947fdf88edb1fdf8adc4035/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:38,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:38,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:55:38,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3c8cd4be4947fdf88edb1fdf8adc4035; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71285848, jitterRate=0.06224191188812256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:38,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:38,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035., pid=103, masterSystemTime=1679309738495 2023-03-20 10:55:38,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-20 10:55:38,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-20 10:55:38,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:38,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:38,761 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=3c8cd4be4947fdf88edb1fdf8adc4035, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:38,761 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679309738761"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309738761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309738761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309738761"}]},"ts":"1679309738761"} 2023-03-20 10:55:38,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-03-20 10:55:38,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 3c8cd4be4947fdf88edb1fdf8adc4035, server=jenkins-hbase20.apache.org,44189,1679309623230 in 418 msec 2023-03-20 10:55:38,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-03-20 10:55:38,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c8cd4be4947fdf88edb1fdf8adc4035, ASSIGN in 577 msec 2023-03-20 10:55:38,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309738766"}]},"ts":"1679309738766"} 2023-03-20 10:55:38,767 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-20 10:55:38,768 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-20 10:55:38,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 590 msec 2023-03-20 10:55:38,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-20 10:55:38,788 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-20 10:55:38,801 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:38,810 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:38,820 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:38,821 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:38,828 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-20 10:55:38,849 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-20 10:55:38,850 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:38,850 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(139): Connect 0x56bb74b2 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:38,853 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7025662b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:38,854 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:38,854 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:38,854 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:39,744 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320b3b7ec7e2ff44e6cbc21889396385c8c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230320b3b7ec7e2ff44e6cbc21889396385c8c 2023-03-20 10:55:39,746 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,751 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303207b79ac9bf945448f897c549c6fd005b2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303207b79ac9bf945448f897c549c6fd005b2 2023-03-20 10:55:39,753 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,757 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320dd0a448a84104aaca1baaf45e3def9dc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230320dd0a448a84104aaca1baaf45e3def9dc 2023-03-20 10:55:39,758 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,763 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:39,766 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:39,772 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:55:39,783 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32812, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:55:39,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/486b1f77d976435c9b4d080d10d6d91e first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-20 10:55:39,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/77567b281fe745e98e61245124fb9718 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-20 10:55:39,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/a87f83d4f27a43a98723672b856bd530 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-20 10:55:39,811 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/77567b281fe745e98e61245124fb9718}] 2023-03-20 10:55:39,811 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/486b1f77d976435c9b4d080d10d6d91e}] 2023-03-20 10:55:39,811 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/a87f83d4f27a43a98723672b856bd530}] 2023-03-20 10:55:39,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/a87f83d4f27a43a98723672b856bd530 for inclusion in 3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:39,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/486b1f77d976435c9b4d080d10d6d91e for inclusion in e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:39,817 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/77567b281fe745e98e61245124fb9718 for inclusion in c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-20 10:55:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-20 10:55:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-20 10:55:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-20 10:55:39,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-20 10:55:39,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:39,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last=1 2023-03-20 10:55:39,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320/family1/486b1f77d976435c9b4d080d10d6d91e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__vqkmt2ihmna36vnp4qotrlmuufmhas1l3gn22knoas3uq3fcc1tuo0t1bqimf6r3/family1/486b1f77d976435c9b4d080d10d6d91e 2023-03-20 10:55:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320/family1/77567b281fe745e98e61245124fb9718 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__4dgjbbr62324ak4bv2udfr0olc33ldclefmv91gf9cp4gngnf0icteaqku3kf88h/family1/77567b281fe745e98e61245124fb9718 2023-03-20 10:55:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320/family1/a87f83d4f27a43a98723672b856bd530 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__k38okpj2f081hts3r55lo3jo6eap6r2th5qptk1bep9b525vtid9vuh7edvtu4c/family1/a87f83d4f27a43a98723672b856bd530 2023-03-20 10:55:39,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__4dgjbbr62324ak4bv2udfr0olc33ldclefmv91gf9cp4gngnf0icteaqku3kf88h/family1/77567b281fe745e98e61245124fb9718 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_ 2023-03-20 10:55:39,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__vqkmt2ihmna36vnp4qotrlmuufmhas1l3gn22knoas3uq3fcc1tuo0t1bqimf6r3/family1/486b1f77d976435c9b4d080d10d6d91e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a78fca9dbaa4a92aa2070a1110cc8c1_SeqId_34_ 2023-03-20 10:55:39,823 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__4dgjbbr62324ak4bv2udfr0olc33ldclefmv91gf9cp4gngnf0icteaqku3kf88h/family1/77567b281fe745e98e61245124fb9718 into c00186bd850f4540e39bc2caef12c922/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_ - updating store file list. 2023-03-20 10:55:39,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__vqkmt2ihmna36vnp4qotrlmuufmhas1l3gn22knoas3uq3fcc1tuo0t1bqimf6r3/family1/486b1f77d976435c9b4d080d10d6d91e into e0ef86d3f8b59492e591fb6178d48b92/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a78fca9dbaa4a92aa2070a1110cc8c1_SeqId_34_ - updating store file list. 2023-03-20 10:55:39,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__k38okpj2f081hts3r55lo3jo6eap6r2th5qptk1bep9b525vtid9vuh7edvtu4c/family1/a87f83d4f27a43a98723672b856bd530 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_ 2023-03-20 10:55:39,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__k38okpj2f081hts3r55lo3jo6eap6r2th5qptk1bep9b525vtid9vuh7edvtu4c/family1/a87f83d4f27a43a98723672b856bd530 into 3c8cd4be4947fdf88edb1fdf8adc4035/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_ - updating store file list. 2023-03-20 10:55:39,828 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_ into c00186bd850f4540e39bc2caef12c922/family1 2023-03-20 10:55:39,828 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__4dgjbbr62324ak4bv2udfr0olc33ldclefmv91gf9cp4gngnf0icteaqku3kf88h/family1/77567b281fe745e98e61245124fb9718 into c00186bd850f4540e39bc2caef12c922/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_) 2023-03-20 10:55:39,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__4dgjbbr62324ak4bv2udfr0olc33ldclefmv91gf9cp4gngnf0icteaqku3kf88h/family1/77567b281fe745e98e61245124fb9718 2023-03-20 10:55:39,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:39,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a78fca9dbaa4a92aa2070a1110cc8c1_SeqId_34_ into e0ef86d3f8b59492e591fb6178d48b92/family1 2023-03-20 10:55:39,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__vqkmt2ihmna36vnp4qotrlmuufmhas1l3gn22knoas3uq3fcc1tuo0t1bqimf6r3/family1/486b1f77d976435c9b4d080d10d6d91e into e0ef86d3f8b59492e591fb6178d48b92/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/7a78fca9dbaa4a92aa2070a1110cc8c1_SeqId_34_) 2023-03-20 10:55:39,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_ into 3c8cd4be4947fdf88edb1fdf8adc4035/family1 2023-03-20 10:55:39,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__k38okpj2f081hts3r55lo3jo6eap6r2th5qptk1bep9b525vtid9vuh7edvtu4c/family1/a87f83d4f27a43a98723672b856bd530 into 3c8cd4be4947fdf88edb1fdf8adc4035/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_) 2023-03-20 10:55:39,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__vqkmt2ihmna36vnp4qotrlmuufmhas1l3gn22knoas3uq3fcc1tuo0t1bqimf6r3/family1/486b1f77d976435c9b4d080d10d6d91e 2023-03-20 10:55:39,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testCompactionWithHFileLink__k38okpj2f081hts3r55lo3jo6eap6r2th5qptk1bep9b525vtid9vuh7edvtu4c/family1/a87f83d4f27a43a98723672b856bd530 2023-03-20 10:55:39,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-20 10:55:39,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(1912): c00186bd850f4540e39bc2caef12c922/family1 is initiating minor compaction (all files) 2023-03-20 10:55:39,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1cb0ea48; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-20 10:55:39,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:39,834 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,835 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:39,835 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,836 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:39,836 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303202a49e05ef64b412298908cf9bbdcf782 2023-03-20 10:55:39,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-20 10:55:39,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(1912): 3c8cd4be4947fdf88edb1fdf8adc4035/family1 is initiating minor compaction (all files) 2023-03-20 10:55:39,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6c24f3f4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-20 10:55:39,837 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303204e8066f50ac24c2db6b2e7daab18bf6c 2023-03-20 10:55:39,837 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023032035b9ffa947fd43cdab6089ea8bf76cdb 2023-03-20 10:55:39,838 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303208022cbd0b05e4792a1d103330c52c05a 2023-03-20 10:55:39,838 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230320573eb69a02144f18a527b7d0223e39da 2023-03-20 10:55:39,838 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,839 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230320a4f08d0b974440d5b7f7b35d859ee3e4 2023-03-20 10:55:39,839 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-20 10:55:39,839 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230320' 2023-03-20 10:55:39,839 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303208772b5193e5e4683b01b18e8c5ef19ad 2023-03-20 10:55:39,839 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:39,840 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:39,840 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230320ce5b9a9423d9417f88fd5dd457bc1ffa 2023-03-20 10:55:39,840 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-20 10:55:39,840 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230320' 2023-03-20 10:55:39,841 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303207b6f600daa9348288930fb0ce00ec399 2023-03-20 10:55:39,841 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:39,841 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230320dc7733cbefc7499781350f2cdc7de415 2023-03-20 10:55:39,842 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230320e5fe4e5c52a14b338b679b5eb7868a6c 2023-03-20 10:55:39,843 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230320ec9e6d6f241f470db4b734f198e25b24 2023-03-20 10:55:39,843 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-20 10:55:39,843 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230320' 2023-03-20 10:55:39,845 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230320 for table='testCompactionWithHFileLink' and column='family1' 2023-03-20 10:55:39,845 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-20 10:55:39,847 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:39,850 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:39,853 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:39,854 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:39,860 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:39,861 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:39,874 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 242) - Thread LEAK? -, OpenFileDescriptor=762 (was 602) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=372 (was 337) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 187), AvailableMemoryMB=8713 (was 8811) 2023-03-20 10:55:39,883 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family2/826a1e53a4bb4229893dcdb71bd2cef4 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/826a1e53a4bb4229893dcdb71bd2cef4 2023-03-20 10:55:39,884 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/.tmp/family1/126792343d3c4417895ff8ef46ac845a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/126792343d3c4417895ff8ef46ac845a 2023-03-20 10:55:39,887 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e0ef86d3f8b59492e591fb6178d48b92/family2 of e0ef86d3f8b59492e591fb6178d48b92 into 826a1e53a4bb4229893dcdb71bd2cef4(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:39,887 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e0ef86d3f8b59492e591fb6178d48b92/family1 of e0ef86d3f8b59492e591fb6178d48b92 into 126792343d3c4417895ff8ef46ac845a(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:39,887 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:39,887 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:55:39,887 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92., storeName=e0ef86d3f8b59492e591fb6178d48b92/family2, priority=12, startTime=1679309738594; duration=1sec 2023-03-20 10:55:39,887 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92., storeName=e0ef86d3f8b59492e591fb6178d48b92/family1, priority=12, startTime=1679309738593; duration=1sec 2023-03-20 10:55:39,887 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-20 10:55:39,887 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-20 10:55:39,887 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c00186bd850f4540e39bc2caef12c922/family1 in testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:39,888 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3c8cd4be4947fdf88edb1fdf8adc4035/family1 in testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:39,888 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-d0d25d6c489d4ca48325361a1b46fa13, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-71dc519219b8466f844ddce23e2ba862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-c4b57356f6264512a450e9873de12bd4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3a3f1be0321048819f4959d5e5047023, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp, totalSize=28.9 K 2023-03-20 10:55:39,888 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-b770f2e4165844348c4edba8d880b2fb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-1dcd99f49ca8459dba4bf3e28d495382, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-a8bc4c21ab8d461aa6a2a8b5a211c99b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-bc3d2821a41e45158b2cf509744dc526, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp, totalSize=28.9 K 2023-03-20 10:55:39,888 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-d0d25d6c489d4ca48325361a1b46fa13, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:39,888 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-b770f2e4165844348c4edba8d880b2fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:39,888 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=762, MaxFileDescriptor=60000, SystemLoadAverage=372, ProcessCount=187, AvailableMemoryMB=8712 2023-03-20 10:55:39,889 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-71dc519219b8466f844ddce23e2ba862, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:39,889 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-1dcd99f49ca8459dba4bf3e28d495382, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:39,890 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-c4b57356f6264512a450e9873de12bd4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:39,890 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-a8bc4c21ab8d461aa6a2a8b5a211c99b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:39,890 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3a3f1be0321048819f4959d5e5047023, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:39,890 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-bc3d2821a41e45158b2cf509744dc526, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721308 2023-03-20 10:55:39,890 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting d082ba69575b4b2087a2cc83ea601c74_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1679309716300 2023-03-20 10:55:39,890 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 59c17fb5038a4766a98657203c60adbc_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1679309716300 2023-03-20 10:55:39,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-03-20 10:55:39,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-20 10:55:39,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-1c6edeb65fba49f2990a4aa1b11f9364, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-0583b0cfc4e8452bb43edac5d5782662, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-21d8115aba044a059792bc558b24da8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-7a5970f13ed04f62a91d8e921981fb6e] to archive 2023-03-20 10:55:39,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:39,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-20 10:55:39,900 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-20 10:55:39,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-1c6edeb65fba49f2990a4aa1b11f9364 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-1c6edeb65fba49f2990a4aa1b11f9364 2023-03-20 10:55:39,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-0583b0cfc4e8452bb43edac5d5782662 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-0583b0cfc4e8452bb43edac5d5782662 2023-03-20 10:55:39,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-03-20 10:55:39,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-21d8115aba044a059792bc558b24da8b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-21d8115aba044a059792bc558b24da8b 2023-03-20 10:55:39,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-7a5970f13ed04f62a91d8e921981fb6e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family1/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-7a5970f13ed04f62a91d8e921981fb6e 2023-03-20 10:55:39,905 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] throttle.PressureAwareThroughputController(145): c00186bd850f4540e39bc2caef12c922#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:39,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-ec5cbb67fa6c46c28a7336685398e8a4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-e1d079c267a640e3961b321f446bc7bf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-9bfe3c70c8534469bd6f91dbe095148c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-5472a8e7a2c548ceac231c2b5bbdbf3e] to archive 2023-03-20 10:55:39,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:39,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-ec5cbb67fa6c46c28a7336685398e8a4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-ec5cbb67fa6c46c28a7336685398e8a4 2023-03-20 10:55:39,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-e1d079c267a640e3961b321f446bc7bf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-e1d079c267a640e3961b321f446bc7bf 2023-03-20 10:55:39,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-9bfe3c70c8534469bd6f91dbe095148c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-9bfe3c70c8534469bd6f91dbe095148c 2023-03-20 10:55:39,910 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3c8cd4be4947fdf88edb1fdf8adc4035#family1#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:39,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-5472a8e7a2c548ceac231c2b5bbdbf3e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/family2/testCompactionWithHFileLink=e0ef86d3f8b59492e591fb6178d48b92-5472a8e7a2c548ceac231c2b5bbdbf3e 2023-03-20 10:55:40,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-20 10:55:40,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-20 10:55:40,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-20 10:55:40,009 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:55:40,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-20 10:55:40,011 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:55:40,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-20 10:55:40,014 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:40,014 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:40,014 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132 2023-03-20 10:55:40,015 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b empty. 2023-03-20 10:55:40,015 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132 empty. 2023-03-20 10:55:40,015 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3 empty. 2023-03-20 10:55:40,015 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:40,015 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132 2023-03-20 10:55:40,015 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:40,015 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-20 10:55:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-20 10:55:40,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-20 10:55:40,426 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-20 10:55:40,427 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => af00e67c6039a735f18797dedd567132, NAME => 'ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:40,427 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => d6d1d1bb207a093cc32d1ceea5d628b3, NAME => 'ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:40,427 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => a5a7eb0c16894ccc2304d0ab4b06501b, NAME => 'ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:40,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-20 10:55:40,774 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing af00e67c6039a735f18797dedd567132, disabling compactions & flushes 2023-03-20 10:55:40,837 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing a5a7eb0c16894ccc2304d0ab4b06501b, disabling compactions & flushes 2023-03-20 10:55:40,837 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. after waiting 0 ms 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. after waiting 0 ms 2023-03-20 10:55:40,837 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:40,837 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:40,837 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:40,842 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:40,842 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing d6d1d1bb207a093cc32d1ceea5d628b3, disabling compactions & flushes 2023-03-20 10:55:40,842 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:40,842 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:40,842 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. after waiting 0 ms 2023-03-20 10:55:40,842 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:40,842 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:40,842 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:40,845 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:55:40,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679309740846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309740846"}]},"ts":"1679309740846"} 2023-03-20 10:55:40,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679309740846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309740846"}]},"ts":"1679309740846"} 2023-03-20 10:55:40,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679309740846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309740846"}]},"ts":"1679309740846"} 2023-03-20 10:55:40,848 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-20 10:55:40,849 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:55:40,849 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309740849"}]},"ts":"1679309740849"} 2023-03-20 10:55:40,850 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-20 10:55:40,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a5a7eb0c16894ccc2304d0ab4b06501b, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d6d1d1bb207a093cc32d1ceea5d628b3, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=af00e67c6039a735f18797dedd567132, ASSIGN}] 2023-03-20 10:55:40,855 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d6d1d1bb207a093cc32d1ceea5d628b3, ASSIGN 2023-03-20 10:55:40,855 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a5a7eb0c16894ccc2304d0ab4b06501b, ASSIGN 2023-03-20 10:55:40,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=af00e67c6039a735f18797dedd567132, ASSIGN 2023-03-20 10:55:40,855 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d6d1d1bb207a093cc32d1ceea5d628b3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:40,856 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a5a7eb0c16894ccc2304d0ab4b06501b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:40,856 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=af00e67c6039a735f18797dedd567132, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:41,008 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a5a7eb0c16894ccc2304d0ab4b06501b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:41,008 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=af00e67c6039a735f18797dedd567132, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:41,008 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d6d1d1bb207a093cc32d1ceea5d628b3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:41,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679309741008"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309741008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309741008"}]},"ts":"1679309741008"} 2023-03-20 10:55:41,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679309741008"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309741008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309741008"}]},"ts":"1679309741008"} 2023-03-20 10:55:41,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679309741008"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309741008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309741008"}]},"ts":"1679309741008"} 2023-03-20 10:55:41,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d6d1d1bb207a093cc32d1ceea5d628b3, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:41,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure a5a7eb0c16894ccc2304d0ab4b06501b, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:41,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure af00e67c6039a735f18797dedd567132, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:41,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-20 10:55:41,131 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family1/612e701bf3e34ed5b0338e0590001239 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/612e701bf3e34ed5b0338e0590001239 2023-03-20 10:55:41,131 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family1/657c879288f6415fa6f12ed2669c0859 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/657c879288f6415fa6f12ed2669c0859 2023-03-20 10:55:41,135 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c00186bd850f4540e39bc2caef12c922/family1 of c00186bd850f4540e39bc2caef12c922 into 612e701bf3e34ed5b0338e0590001239(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:41,136 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:41,136 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 3c8cd4be4947fdf88edb1fdf8adc4035/family1 of 3c8cd4be4947fdf88edb1fdf8adc4035 into 657c879288f6415fa6f12ed2669c0859(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:41,136 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1679309739833; duration=1sec 2023-03-20 10:55:41,136 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:41,136 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-20 10:55:41,136 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-20 10:55:41,136 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1679309739836; duration=1sec 2023-03-20 10:55:41,136 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-20 10:55:41,136 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-20 10:55:41,138 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-20 10:55:41,139 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-20 10:55:41,139 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1912): c00186bd850f4540e39bc2caef12c922/family2 is initiating minor compaction (all files) 2023-03-20 10:55:41,139 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1912): 3c8cd4be4947fdf88edb1fdf8adc4035/family2 is initiating minor compaction (all files) 2023-03-20 10:55:41,139 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c00186bd850f4540e39bc2caef12c922/family2 in testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:55:41,139 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3c8cd4be4947fdf88edb1fdf8adc4035/family2 in testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:55:41,139 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-4d52e9fe9b92417088c18666c5facd2b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-0ef7d64a2176478fa569dbdea08c79f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-db04c9df44be43bab07be36df0261c69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3ac497c49457427caf6a8e7cd5c105bc] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp, totalSize=20.4 K 2023-03-20 10:55:41,139 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-99e1a51dbabf41009722cdb2477273c7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-46c4378844f14aa8af546f3c7309c670, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-c4a18005f56f4e4e99df9afb595d587d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-12a74287105f40fa973d0144fbd31976] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp, totalSize=20.4 K 2023-03-20 10:55:41,139 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-4d52e9fe9b92417088c18666c5facd2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:41,140 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-99e1a51dbabf41009722cdb2477273c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309716300 2023-03-20 10:55:41,140 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-0ef7d64a2176478fa569dbdea08c79f7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:41,140 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-46c4378844f14aa8af546f3c7309c670, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309717697 2023-03-20 10:55:41,141 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-db04c9df44be43bab07be36df0261c69, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:41,141 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-c4a18005f56f4e4e99df9afb595d587d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309719503 2023-03-20 10:55:41,141 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3ac497c49457427caf6a8e7cd5c105bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721309 2023-03-20 10:55:41,142 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-12a74287105f40fa973d0144fbd31976, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309721308 2023-03-20 10:55:41,152 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3c8cd4be4947fdf88edb1fdf8adc4035#family2#compaction#118 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:41,153 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] throttle.PressureAwareThroughputController(145): c00186bd850f4540e39bc2caef12c922#family2#compaction#119 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:41,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:41,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6d1d1bb207a093cc32d1ceea5d628b3, NAME => 'ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.', STARTKEY => '1', ENDKEY => '2'} 2023-03-20 10:55:41,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:41,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,167 INFO [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,168 DEBUG [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1 2023-03-20 10:55:41,168 DEBUG [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1 2023-03-20 10:55:41,169 INFO [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6d1d1bb207a093cc32d1ceea5d628b3 columnFamilyName family1 2023-03-20 10:55:41,170 INFO [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] regionserver.HStore(310): Store=d6d1d1bb207a093cc32d1ceea5d628b3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:41,170 INFO [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,171 DEBUG [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2 2023-03-20 10:55:41,172 DEBUG [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2 2023-03-20 10:55:41,172 INFO [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6d1d1bb207a093cc32d1ceea5d628b3 columnFamilyName family2 2023-03-20 10:55:41,173 INFO [StoreOpener-d6d1d1bb207a093cc32d1ceea5d628b3-1] regionserver.HStore(310): Store=d6d1d1bb207a093cc32d1ceea5d628b3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:41,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:55:41,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:41,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d6d1d1bb207a093cc32d1ceea5d628b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64077065, jitterRate=-0.04517732560634613}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:41,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:41,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3., pid=109, masterSystemTime=1679309741162 2023-03-20 10:55:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:41,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:41,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5a7eb0c16894ccc2304d0ab4b06501b, NAME => 'ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.', STARTKEY => '', ENDKEY => '1'} 2023-03-20 10:55:41,180 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d6d1d1bb207a093cc32d1ceea5d628b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,180 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679309741180"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309741180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309741180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309741180"}]},"ts":"1679309741180"} 2023-03-20 10:55:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,181 INFO [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-03-20 10:55:41,182 DEBUG [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1 2023-03-20 10:55:41,183 DEBUG [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1 2023-03-20 10:55:41,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d6d1d1bb207a093cc32d1ceea5d628b3, server=jenkins-hbase20.apache.org,44189,1679309623230 in 171 msec 2023-03-20 10:55:41,183 INFO [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5a7eb0c16894ccc2304d0ab4b06501b columnFamilyName family1 2023-03-20 10:55:41,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d6d1d1bb207a093cc32d1ceea5d628b3, ASSIGN in 330 msec 2023-03-20 10:55:41,184 INFO [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] regionserver.HStore(310): Store=a5a7eb0c16894ccc2304d0ab4b06501b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:41,184 INFO [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,185 DEBUG [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2 2023-03-20 10:55:41,185 DEBUG [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2 2023-03-20 10:55:41,185 INFO [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5a7eb0c16894ccc2304d0ab4b06501b columnFamilyName family2 2023-03-20 10:55:41,186 INFO [StoreOpener-a5a7eb0c16894ccc2304d0ab4b06501b-1] regionserver.HStore(310): Store=a5a7eb0c16894ccc2304d0ab4b06501b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:41,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:41,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:55:41,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:41,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a5a7eb0c16894ccc2304d0ab4b06501b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67360439, jitterRate=0.003748759627342224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:41,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:41,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b., pid=110, masterSystemTime=1679309741162 2023-03-20 10:55:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:41,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:41,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:41,194 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a5a7eb0c16894ccc2304d0ab4b06501b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af00e67c6039a735f18797dedd567132, NAME => 'ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.', STARTKEY => '2', ENDKEY => ''} 2023-03-20 10:55:41,194 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679309741194"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309741194"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309741194"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309741194"}]},"ts":"1679309741194"} 2023-03-20 10:55:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,196 INFO [StoreOpener-af00e67c6039a735f18797dedd567132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-03-20 10:55:41,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure a5a7eb0c16894ccc2304d0ab4b06501b, server=jenkins-hbase20.apache.org,44189,1679309623230 in 184 msec 2023-03-20 10:55:41,197 DEBUG [StoreOpener-af00e67c6039a735f18797dedd567132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1 2023-03-20 10:55:41,197 DEBUG [StoreOpener-af00e67c6039a735f18797dedd567132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1 2023-03-20 10:55:41,197 INFO [StoreOpener-af00e67c6039a735f18797dedd567132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af00e67c6039a735f18797dedd567132 columnFamilyName family1 2023-03-20 10:55:41,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a5a7eb0c16894ccc2304d0ab4b06501b, ASSIGN in 343 msec 2023-03-20 10:55:41,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-d0d25d6c489d4ca48325361a1b46fa13, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-71dc519219b8466f844ddce23e2ba862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-c4b57356f6264512a450e9873de12bd4, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3a3f1be0321048819f4959d5e5047023, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_] to archive 2023-03-20 10:55:41,198 INFO [StoreOpener-af00e67c6039a735f18797dedd567132-1] regionserver.HStore(310): Store=af00e67c6039a735f18797dedd567132/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:41,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:41,198 INFO [StoreOpener-af00e67c6039a735f18797dedd567132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,199 DEBUG [StoreOpener-af00e67c6039a735f18797dedd567132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2 2023-03-20 10:55:41,199 DEBUG [StoreOpener-af00e67c6039a735f18797dedd567132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2 2023-03-20 10:55:41,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-d0d25d6c489d4ca48325361a1b46fa13 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-d0d25d6c489d4ca48325361a1b46fa13 2023-03-20 10:55:41,199 INFO [StoreOpener-af00e67c6039a735f18797dedd567132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af00e67c6039a735f18797dedd567132 columnFamilyName family2 2023-03-20 10:55:41,200 INFO [StoreOpener-af00e67c6039a735f18797dedd567132-1] regionserver.HStore(310): Store=af00e67c6039a735f18797dedd567132/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:41,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-71dc519219b8466f844ddce23e2ba862 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-71dc519219b8466f844ddce23e2ba862 2023-03-20 10:55:41,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-c4b57356f6264512a450e9873de12bd4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-c4b57356f6264512a450e9873de12bd4 2023-03-20 10:55:41,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:55:41,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3a3f1be0321048819f4959d5e5047023 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3a3f1be0321048819f4959d5e5047023 2023-03-20 10:55:41,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for af00e67c6039a735f18797dedd567132 2023-03-20 10:55:41,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family1/d082ba69575b4b2087a2cc83ea601c74_SeqId_34_ 2023-03-20 10:55:41,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-b770f2e4165844348c4edba8d880b2fb, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-1dcd99f49ca8459dba4bf3e28d495382, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-a8bc4c21ab8d461aa6a2a8b5a211c99b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-bc3d2821a41e45158b2cf509744dc526, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_] to archive 2023-03-20 10:55:41,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:41,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:41,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened af00e67c6039a735f18797dedd567132; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64379336, jitterRate=-0.040673136711120605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:55:41,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:41,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132., pid=111, masterSystemTime=1679309741162 2023-03-20 10:55:41,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-b770f2e4165844348c4edba8d880b2fb to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-b770f2e4165844348c4edba8d880b2fb 2023-03-20 10:55:41,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:41,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:41,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=af00e67c6039a735f18797dedd567132, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:41,207 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679309741207"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309741207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309741207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309741207"}]},"ts":"1679309741207"} 2023-03-20 10:55:41,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-1dcd99f49ca8459dba4bf3e28d495382 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-1dcd99f49ca8459dba4bf3e28d495382 2023-03-20 10:55:41,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-a8bc4c21ab8d461aa6a2a8b5a211c99b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-a8bc4c21ab8d461aa6a2a8b5a211c99b 2023-03-20 10:55:41,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-03-20 10:55:41,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure af00e67c6039a735f18797dedd567132, server=jenkins-hbase20.apache.org,44189,1679309623230 in 196 msec 2023-03-20 10:55:41,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-bc3d2821a41e45158b2cf509744dc526 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-bc3d2821a41e45158b2cf509744dc526 2023-03-20 10:55:41,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family1/59c17fb5038a4766a98657203c60adbc_SeqId_34_ 2023-03-20 10:55:41,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-03-20 10:55:41,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=af00e67c6039a735f18797dedd567132, ASSIGN in 356 msec 2023-03-20 10:55:41,211 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:55:41,211 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309741211"}]},"ts":"1679309741211"} 2023-03-20 10:55:41,212 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-20 10:55:41,213 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:55:41,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2080 sec 2023-03-20 10:55:42,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-20 10:55:42,119 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-20 10:55:42,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:42,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:42,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:42,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:42,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-20 10:55:42,136 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-20 10:55:42,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:42,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-20 10:55:42,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-20 10:55:42,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:42,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:42,138 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:42,138 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:42,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:42,139 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:42,139 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:42,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:42,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-20 10:55:42,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-20 10:55:42,141 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-20 10:55:42,141 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:42,141 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-20 10:55:42,142 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:42,142 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. started... 2023-03-20 10:55:42,142 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:42,142 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:42,142 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:42,145 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing af00e67c6039a735f18797dedd567132 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:55:42,144 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:42,145 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. started... 2023-03-20 10:55:42,145 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. started... 2023-03-20 10:55:42,145 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d6d1d1bb207a093cc32d1ceea5d628b3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:55:42,145 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a5a7eb0c16894ccc2304d0ab4b06501b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:55:42,373 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/.tmp/family2/995c4937601e490eb2cb6fdf3e958f8a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/995c4937601e490eb2cb6fdf3e958f8a 2023-03-20 10:55:42,373 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/.tmp/family2/88f0150e4e9949fe8de8c696d98a1f5e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/88f0150e4e9949fe8de8c696d98a1f5e 2023-03-20 10:55:42,378 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c00186bd850f4540e39bc2caef12c922/family2 of c00186bd850f4540e39bc2caef12c922 into 88f0150e4e9949fe8de8c696d98a1f5e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:42,378 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3c8cd4be4947fdf88edb1fdf8adc4035/family2 of 3c8cd4be4947fdf88edb1fdf8adc4035 into 995c4937601e490eb2cb6fdf3e958f8a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:42,378 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:55:42,378 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:55:42,379 INFO [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922., storeName=c00186bd850f4540e39bc2caef12c922/family2, priority=12, startTime=1679309738690; duration=1sec 2023-03-20 10:55:42,379 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035., storeName=3c8cd4be4947fdf88edb1fdf8adc4035/family2, priority=12, startTime=1679309738759; duration=1sec 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-20 10:55:42,379 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. because compaction request was cancelled 2023-03-20 10:55:42,380 DEBUG [RS:0;jenkins-hbase20:44189-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. because compaction request was cancelled 2023-03-20 10:55:42,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-4d52e9fe9b92417088c18666c5facd2b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-0ef7d64a2176478fa569dbdea08c79f7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-db04c9df44be43bab07be36df0261c69, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3ac497c49457427caf6a8e7cd5c105bc] to archive 2023-03-20 10:55:42,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:42,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-4d52e9fe9b92417088c18666c5facd2b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-4d52e9fe9b92417088c18666c5facd2b 2023-03-20 10:55:42,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-0ef7d64a2176478fa569dbdea08c79f7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-0ef7d64a2176478fa569dbdea08c79f7 2023-03-20 10:55:42,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-db04c9df44be43bab07be36df0261c69 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-db04c9df44be43bab07be36df0261c69 2023-03-20 10:55:42,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3ac497c49457427caf6a8e7cd5c105bc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/family2/testCompactionWithHFileLink=c00186bd850f4540e39bc2caef12c922-3ac497c49457427caf6a8e7cd5c105bc 2023-03-20 10:55:42,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-99e1a51dbabf41009722cdb2477273c7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-46c4378844f14aa8af546f3c7309c670, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-c4a18005f56f4e4e99df9afb595d587d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-12a74287105f40fa973d0144fbd31976] to archive 2023-03-20 10:55:42,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:42,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-99e1a51dbabf41009722cdb2477273c7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-99e1a51dbabf41009722cdb2477273c7 2023-03-20 10:55:42,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-46c4378844f14aa8af546f3c7309c670 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-46c4378844f14aa8af546f3c7309c670 2023-03-20 10:55:42,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-c4a18005f56f4e4e99df9afb595d587d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-c4a18005f56f4e4e99df9afb595d587d 2023-03-20 10:55:42,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-12a74287105f40fa973d0144fbd31976 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/family2/testCompactionWithHFileLink=3c8cd4be4947fdf88edb1fdf8adc4035-12a74287105f40fa973d0144fbd31976 2023-03-20 10:55:42,559 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320fd51b5d439384dc3836d819268dddace to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230320fd51b5d439384dc3836d819268dddace 2023-03-20 10:55:42,559 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320e13fb74ec09d4f08a590c44b52fc05cc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230320e13fb74ec09d4f08a590c44b52fc05cc 2023-03-20 10:55:42,559 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320ee93909fc89848e79188593d0407b994 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230320ee93909fc89848e79188593d0407b994 2023-03-20 10:55:42,572 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/ffb023824a0846a58ca452fbbeba048b 2023-03-20 10:55:42,972 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/36fb5efd448349f88371045ff213a1f8 2023-03-20 10:55:42,972 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/6ee26674c6904f0f81d9b3eedc3bab2c 2023-03-20 10:55:42,986 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032037d64cd4b4354690b387f9a07f229ae1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023032037d64cd4b4354690b387f9a07f229ae1 2023-03-20 10:55:43,389 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320290bf6c194f44d53adb7b8aa58f4ce3f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230320290bf6c194f44d53adb7b8aa58f4ce3f 2023-03-20 10:55:43,389 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320e25c48ec21b34a0baadce30fdca1356b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230320e25c48ec21b34a0baadce30fdca1356b 2023-03-20 10:55:43,391 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/d3432c0f94934c998dbbeae5e3eaa9ab 2023-03-20 10:55:43,395 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/386cbae8a55b4c23a111de3c09eda37e 2023-03-20 10:55:43,397 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/ffb023824a0846a58ca452fbbeba048b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/ffb023824a0846a58ca452fbbeba048b 2023-03-20 10:55:43,400 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/6ee26674c6904f0f81d9b3eedc3bab2c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/6ee26674c6904f0f81d9b3eedc3bab2c 2023-03-20 10:55:43,401 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/ffb023824a0846a58ca452fbbeba048b, entries=4, sequenceid=5, filesize=5.4 K 2023-03-20 10:55:43,402 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/d3432c0f94934c998dbbeae5e3eaa9ab as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/d3432c0f94934c998dbbeae5e3eaa9ab 2023-03-20 10:55:43,408 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/6ee26674c6904f0f81d9b3eedc3bab2c, entries=4, sequenceid=5, filesize=5.4 K 2023-03-20 10:55:43,409 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/386cbae8a55b4c23a111de3c09eda37e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/386cbae8a55b4c23a111de3c09eda37e 2023-03-20 10:55:43,409 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/d3432c0f94934c998dbbeae5e3eaa9ab, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:55:43,409 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for af00e67c6039a735f18797dedd567132 in 1265ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:43,409 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-20 10:55:43,410 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:43,410 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:43,410 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:43,412 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/386cbae8a55b4c23a111de3c09eda37e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:55:43,413 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a5a7eb0c16894ccc2304d0ab4b06501b in 1268ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:43,414 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:43,414 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:43,414 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:43,795 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/bc6bfeff5f89454eba24fb37097e873c 2023-03-20 10:55:43,803 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/36fb5efd448349f88371045ff213a1f8 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/36fb5efd448349f88371045ff213a1f8 2023-03-20 10:55:43,810 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/36fb5efd448349f88371045ff213a1f8, entries=4, sequenceid=5, filesize=5.4 K 2023-03-20 10:55:43,811 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/bc6bfeff5f89454eba24fb37097e873c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/bc6bfeff5f89454eba24fb37097e873c 2023-03-20 10:55:43,814 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/bc6bfeff5f89454eba24fb37097e873c, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:55:43,815 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d6d1d1bb207a093cc32d1ceea5d628b3 in 1670ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:43,815 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:43,815 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-20 10:55:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-20 10:55:43,816 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,816 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:43,816 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,816 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-20 10:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@777e3215[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:43,817 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-20 10:55:43,817 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,818 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-20 10:55:43,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-20 10:55:43,818 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,818 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:43,818 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:43,819 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-20 10:55:43,819 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,819 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:43,819 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-20 10:55:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:43,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-20 10:55:43,820 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-20 10:55:43,821 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:43,821 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:43,821 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-20 10:55:43,821 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:43,821 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,821 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,821 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:43,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,822 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:43,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:43,822 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:43,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:43,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-20 10:55:43,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:43,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:43,824 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:43,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:43,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:43,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-20 10:55:43,824 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:43,924 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:43,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:43,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:43,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:43,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:43,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:43,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-20 10:55:43,936 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-20 10:55:43,936 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:43,936 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-20 10:55:43,936 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-20 10:55:43,937 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,937 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:43,938 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,938 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:43,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:43,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:43,938 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:43,938 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:43,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:43,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:43,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-20 10:55:43,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-20 10:55:43,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-20 10:55:43,940 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-20 10:55:43,940 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:43,940 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-20 10:55:43,940 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:43,940 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. started... 2023-03-20 10:55:43,940 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:43,940 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing af00e67c6039a735f18797dedd567132 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:55:43,940 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:43,941 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:43,940 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:43,941 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. started... 2023-03-20 10:55:43,941 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. started... 2023-03-20 10:55:43,941 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a5a7eb0c16894ccc2304d0ab4b06501b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:55:43,941 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d6d1d1bb207a093cc32d1ceea5d628b3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:55:44,355 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320fb6a7963e9e245ad896adecde0163811 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230320fb6a7963e9e245ad896adecde0163811 2023-03-20 10:55:44,360 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/016c1407dbf64fc5bc1b5cdd424b5139 2023-03-20 10:55:44,363 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320c6735849230f406fa907e5fc888ac124 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230320c6735849230f406fa907e5fc888ac124 2023-03-20 10:55:44,363 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032016a20ce8c5f440f28e7a87f43d95b938 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023032016a20ce8c5f440f28e7a87f43d95b938 2023-03-20 10:55:44,369 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/d2260da2951a463b89a401c2818c65ad 2023-03-20 10:55:44,760 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-20 10:55:44,771 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/df87d8ca97e1494284f12fe701331e83 2023-03-20 10:55:44,778 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032073508efbcd6341039f9d69240bcc7983 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023032073508efbcd6341039f9d69240bcc7983 2023-03-20 10:55:44,786 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032009a0829f34c64ccdb340d0a8b3ea3075 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023032009a0829f34c64ccdb340d0a8b3ea3075 2023-03-20 10:55:44,795 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320de7c09e2233944bbb3826876fe6a5e72 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230320de7c09e2233944bbb3826876fe6a5e72 2023-03-20 10:55:44,800 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/4618e0729a3f4033b38e3772523eee61 2023-03-20 10:55:44,804 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/df87d8ca97e1494284f12fe701331e83 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/df87d8ca97e1494284f12fe701331e83 2023-03-20 10:55:44,808 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/df87d8ca97e1494284f12fe701331e83, entries=4, sequenceid=9, filesize=5.4 K 2023-03-20 10:55:44,809 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/4618e0729a3f4033b38e3772523eee61 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/4618e0729a3f4033b38e3772523eee61 2023-03-20 10:55:44,813 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/4618e0729a3f4033b38e3772523eee61, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:55:44,814 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d6d1d1bb207a093cc32d1ceea5d628b3 in 873ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:44,814 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:44,814 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:44,814 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:45,186 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/24fb8253596d4560b3215659099ae4bc 2023-03-20 10:55:45,193 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/3be25a917b154cad9009f003761e77ce 2023-03-20 10:55:45,196 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/016c1407dbf64fc5bc1b5cdd424b5139 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/016c1407dbf64fc5bc1b5cdd424b5139 2023-03-20 10:55:45,199 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/d2260da2951a463b89a401c2818c65ad as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/d2260da2951a463b89a401c2818c65ad 2023-03-20 10:55:45,200 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/016c1407dbf64fc5bc1b5cdd424b5139, entries=4, sequenceid=9, filesize=5.4 K 2023-03-20 10:55:45,201 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/24fb8253596d4560b3215659099ae4bc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/24fb8253596d4560b3215659099ae4bc 2023-03-20 10:55:45,203 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/d2260da2951a463b89a401c2818c65ad, entries=4, sequenceid=9, filesize=5.4 K 2023-03-20 10:55:45,204 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/3be25a917b154cad9009f003761e77ce as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/3be25a917b154cad9009f003761e77ce 2023-03-20 10:55:45,205 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/24fb8253596d4560b3215659099ae4bc, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:55:45,206 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for af00e67c6039a735f18797dedd567132 in 1266ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:45,206 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:45,206 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:45,206 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:45,208 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/3be25a917b154cad9009f003761e77ce, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:55:45,209 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a5a7eb0c16894ccc2304d0ab4b06501b in 1268ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:45,210 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:45,210 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:45,210 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:45,210 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:45,210 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,210 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-20 10:55:45,210 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-20 10:55:45,213 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,213 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:45,213 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,213 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:45,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-20 10:55:45,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d15ffc7[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:45,215 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-20 10:55:45,215 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,216 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,216 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-20 10:55:45,216 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-20 10:55:45,216 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:45,216 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,216 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:45,217 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-20 10:55:45,217 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:45,217 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-20 10:55:45,217 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:45,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-20 10:55:45,220 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-20 10:55:45,220 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:45,220 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:45,220 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-20 10:55:45,220 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:45,221 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,221 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:45,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,221 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:45,222 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,223 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:45,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-20 10:55:45,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,224 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:45,224 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,324 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:45,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:45,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:45,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:45,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:45,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:45,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:45,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-20 10:55:45,336 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-20 10:55:45,336 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:45,336 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-20 10:55:45,336 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-20 10:55:45,337 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,337 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:45,338 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,338 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:45,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:45,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:45,339 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:45,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:45,340 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-20 10:55:45,341 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-20 10:55:45,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-20 10:55:45,341 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-20 10:55:45,341 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:45,341 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-20 10:55:45,341 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:45,342 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. started... 2023-03-20 10:55:45,342 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing af00e67c6039a735f18797dedd567132 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:55:45,342 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:45,342 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. started... 2023-03-20 10:55:45,342 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d6d1d1bb207a093cc32d1ceea5d628b3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:55:45,343 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:45,343 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:45,343 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:45,343 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. started... 2023-03-20 10:55:45,344 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a5a7eb0c16894ccc2304d0ab4b06501b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:55:45,766 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320f59d47b849484d869eed28e205aa6c79 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230320f59d47b849484d869eed28e205aa6c79 2023-03-20 10:55:45,766 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303205a66b5afa6224cd6b05de7569bdc820d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303205a66b5afa6224cd6b05de7569bdc820d 2023-03-20 10:55:45,766 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303204546fefb16e74a6fa354f2a45a18fd80 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303204546fefb16e74a6fa354f2a45a18fd80 2023-03-20 10:55:46,173 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/fe5c88baccd8493c9443e77441e81aef 2023-03-20 10:55:46,173 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/3a908902e9c8484a8abea94ec54425c5 2023-03-20 10:55:46,173 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/07dec093eb0e4246b82807e7c1d910dc 2023-03-20 10:55:46,595 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303200d07e4b738d3464ab64a65d987b2373d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303200d07e4b738d3464ab64a65d987b2373d 2023-03-20 10:55:46,598 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320c93d897294384d569d30594d2fa3a173 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230320c93d897294384d569d30594d2fa3a173 2023-03-20 10:55:46,599 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320329a502c660b4150ade6c2f63a360782 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230320329a502c660b4150ade6c2f63a360782 2023-03-20 10:55:46,668 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:55:47,000 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/742fcdf17472459b8c6d00908dc687b6 2023-03-20 10:55:47,003 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/0cea67b54b36446ea7b2f34dd8942e3c 2023-03-20 10:55:47,004 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/3a908902e9c8484a8abea94ec54425c5 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/3a908902e9c8484a8abea94ec54425c5 2023-03-20 10:55:47,006 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/07dec093eb0e4246b82807e7c1d910dc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/07dec093eb0e4246b82807e7c1d910dc 2023-03-20 10:55:47,007 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/3a908902e9c8484a8abea94ec54425c5, entries=4, sequenceid=13, filesize=5.4 K 2023-03-20 10:55:47,008 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/742fcdf17472459b8c6d00908dc687b6 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/742fcdf17472459b8c6d00908dc687b6 2023-03-20 10:55:47,008 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/3783690295034c4e9eaf6b734be0cc40 2023-03-20 10:55:47,009 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/07dec093eb0e4246b82807e7c1d910dc, entries=4, sequenceid=13, filesize=5.4 K 2023-03-20 10:55:47,010 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/0cea67b54b36446ea7b2f34dd8942e3c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/0cea67b54b36446ea7b2f34dd8942e3c 2023-03-20 10:55:47,011 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/742fcdf17472459b8c6d00908dc687b6, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:55:47,011 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/fe5c88baccd8493c9443e77441e81aef as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/fe5c88baccd8493c9443e77441e81aef 2023-03-20 10:55:47,012 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d6d1d1bb207a093cc32d1ceea5d628b3 in 1670ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:47,012 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:47,012 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:47,012 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:47,013 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/0cea67b54b36446ea7b2f34dd8942e3c, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:55:47,014 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a5a7eb0c16894ccc2304d0ab4b06501b in 1671ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:47,014 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:47,014 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:47,014 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:47,015 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/fe5c88baccd8493c9443e77441e81aef, entries=4, sequenceid=13, filesize=5.4 K 2023-03-20 10:55:47,015 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/3783690295034c4e9eaf6b734be0cc40 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/3783690295034c4e9eaf6b734be0cc40 2023-03-20 10:55:47,018 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/3783690295034c4e9eaf6b734be0cc40, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:55:47,019 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for af00e67c6039a735f18797dedd567132 in 1677ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:47,019 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:47,019 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:47,019 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:47,019 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:47,019 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,019 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-20 10:55:47,019 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-20 10:55:47,020 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,020 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:47,021 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,021 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-20 10:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eca1e33[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:47,021 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-20 10:55:47,022 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,022 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,022 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-20 10:55:47,022 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-20 10:55:47,022 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:47,022 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,022 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:47,023 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-20 10:55:47,023 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,023 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:47,023 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-20 10:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:47,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-20 10:55:47,025 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-20 10:55:47,025 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:47,025 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:47,025 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-20 10:55:47,025 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:47,026 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:47,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:47,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:47,026 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,027 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,028 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,028 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:47,028 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:47,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-20 10:55:47,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:47,028 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:47,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:47,028 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:47,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-20 10:55:47,028 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:47,028 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:47,029 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:47,029 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:47,029 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:47,029 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:47,029 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,129 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:47,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:47,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:47,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:47,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:55:47,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:47,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:47,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-20 10:55:47,136 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-20 10:55:47,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:47,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-20 10:55:47,136 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-20 10:55:47,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:47,138 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,138 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:47,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:47,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:47,138 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:47,138 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:47,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:47,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:47,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-20 10:55:47,140 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-20 10:55:47,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-20 10:55:47,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-20 10:55:47,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:47,140 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-20 10:55:47,141 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:47,141 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. started... 2023-03-20 10:55:47,141 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:47,141 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. started... 2023-03-20 10:55:47,141 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing af00e67c6039a735f18797dedd567132 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:55:47,141 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:47,141 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:47,141 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d6d1d1bb207a093cc32d1ceea5d628b3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:55:47,141 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:47,141 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. started... 2023-03-20 10:55:47,142 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a5a7eb0c16894ccc2304d0ab4b06501b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:55:47,155 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303205bc3a38a1e9849608eebb389976a8681 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303205bc3a38a1e9849608eebb389976a8681 2023-03-20 10:55:47,554 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320cf289a483bb84987b2e77067de3022c3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230320cf289a483bb84987b2e77067de3022c3 2023-03-20 10:55:47,555 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320fdc6161e2efd49049fd0d60ad25af3d8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230320fdc6161e2efd49049fd0d60ad25af3d8 2023-03-20 10:55:47,560 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/7864f5bd84be427ba02f3280148c6e0f 2023-03-20 10:55:47,959 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/8d184e3095c14ab1ad4b15ce65942ef5 2023-03-20 10:55:47,959 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/77f6110a2719403696040a7c02652fa7 2023-03-20 10:55:47,973 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303207b2430b8d8bd4e07906b228af3d209ba to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303207b2430b8d8bd4e07906b228af3d209ba 2023-03-20 10:55:48,384 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/0bcb76c05d0646d2bb4caec8c970a015 2023-03-20 10:55:48,384 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320375a347d5965480491ba1aa292f5a9e5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230320375a347d5965480491ba1aa292f5a9e5 2023-03-20 10:55:48,384 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303202738b9a263354a4bb8ffbb2f0317b9b7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303202738b9a263354a4bb8ffbb2f0317b9b7 2023-03-20 10:55:48,389 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/7864f5bd84be427ba02f3280148c6e0f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/7864f5bd84be427ba02f3280148c6e0f 2023-03-20 10:55:48,390 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/a676f503e73f426d84f7bdaa35e3407c 2023-03-20 10:55:48,393 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/7864f5bd84be427ba02f3280148c6e0f, entries=4, sequenceid=17, filesize=5.4 K 2023-03-20 10:55:48,394 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/8d184e3095c14ab1ad4b15ce65942ef5 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/8d184e3095c14ab1ad4b15ce65942ef5 2023-03-20 10:55:48,394 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/0bcb76c05d0646d2bb4caec8c970a015 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/0bcb76c05d0646d2bb4caec8c970a015 2023-03-20 10:55:48,397 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/8d184e3095c14ab1ad4b15ce65942ef5, entries=4, sequenceid=17, filesize=5.4 K 2023-03-20 10:55:48,398 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/0bcb76c05d0646d2bb4caec8c970a015, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:55:48,398 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/a676f503e73f426d84f7bdaa35e3407c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/a676f503e73f426d84f7bdaa35e3407c 2023-03-20 10:55:48,399 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for af00e67c6039a735f18797dedd567132 in 1258ms, sequenceid=17, compaction requested=true 2023-03-20 10:55:48,399 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:48,399 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:48,399 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:48,402 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/a676f503e73f426d84f7bdaa35e3407c, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:55:48,403 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d6d1d1bb207a093cc32d1ceea5d628b3 in 1262ms, sequenceid=17, compaction requested=true 2023-03-20 10:55:48,403 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:48,403 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:48,403 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:48,792 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e 2023-03-20 10:55:48,797 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/77f6110a2719403696040a7c02652fa7 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/77f6110a2719403696040a7c02652fa7 2023-03-20 10:55:48,800 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/77f6110a2719403696040a7c02652fa7, entries=4, sequenceid=17, filesize=5.4 K 2023-03-20 10:55:48,801 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e 2023-03-20 10:55:48,804 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:55:48,805 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a5a7eb0c16894ccc2304d0ab4b06501b in 1664ms, sequenceid=17, compaction requested=true 2023-03-20 10:55:48,805 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:48,805 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-20 10:55:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-20 10:55:48,806 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,806 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:48,807 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,807 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:48,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-20 10:55:48,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@166dd13f[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:48,808 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-20 10:55:48,808 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,808 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-20 10:55:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-20 10:55:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:48,809 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,809 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-20 10:55:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-20 10:55:48,809 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:48,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-20 10:55:48,811 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-20 10:55:48,811 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:48,811 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:48,811 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-20 10:55:48,811 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:48,812 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,812 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,812 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:48,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:48,813 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:48,813 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-20 10:55:48,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:48,815 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:48,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:48,815 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:48,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-20 10:55:48,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:48,915 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:48,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:48,931 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:48,943 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:48,952 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:48,953 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:48,980 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:48,980 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56bb74b2 to 127.0.0.1:62837 2023-03-20 10:55:48,980 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:48,980 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:55:48,980 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534804c5 to 127.0.0.1:62837 2023-03-20 10:55:48,980 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:55:48,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:48,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:48,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-20 10:55:48,993 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-20 10:55:48,993 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:48,993 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-20 10:55:48,993 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-20 10:55:48,994 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,994 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,997 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:48,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:48,997 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:48,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:48,998 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-20 10:55:48,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-20 10:55:48,998 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-20 10:55:48,998 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:48,998 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-20 10:55:48,999 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:48,999 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. started... 2023-03-20 10:55:48,999 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:55:48,999 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing af00e67c6039a735f18797dedd567132 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:55:48,999 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:48,999 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:48,999 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. started... 2023-03-20 10:55:48,999 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:48,999 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a5a7eb0c16894ccc2304d0ab4b06501b 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:55:48,999 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. started... 2023-03-20 10:55:48,999 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d6d1d1bb207a093cc32d1ceea5d628b3 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:55:49,417 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/c3c91e799ab8463fbe6d79af6b3ee54e 2023-03-20 10:55:49,420 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3c91e799ab8463fbe6d79af6b3ee54e 2023-03-20 10:55:49,817 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/b37dc711248c4c4d88f9c79e2096a5d9 2023-03-20 10:55:49,818 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/9b8c3605fbc14270a54f3dad08a381ed 2023-03-20 10:55:49,821 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b37dc711248c4c4d88f9c79e2096a5d9 2023-03-20 10:55:49,821 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b8c3605fbc14270a54f3dad08a381ed 2023-03-20 10:55:50,231 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/c66a66eb629b46169992a2c517d549d1 2023-03-20 10:55:50,237 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c66a66eb629b46169992a2c517d549d1 2023-03-20 10:55:50,237 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/c3c91e799ab8463fbe6d79af6b3ee54e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/c3c91e799ab8463fbe6d79af6b3ee54e 2023-03-20 10:55:50,253 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/fa03d26382c3411e967cb7558ac24cdd 2023-03-20 10:55:50,261 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa03d26382c3411e967cb7558ac24cdd 2023-03-20 10:55:50,261 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3c91e799ab8463fbe6d79af6b3ee54e 2023-03-20 10:55:50,261 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/c3c91e799ab8463fbe6d79af6b3ee54e, entries=3, sequenceid=23, filesize=5.0 K 2023-03-20 10:55:50,262 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/9b8c3605fbc14270a54f3dad08a381ed as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/9b8c3605fbc14270a54f3dad08a381ed 2023-03-20 10:55:50,262 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/c66a66eb629b46169992a2c517d549d1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/c66a66eb629b46169992a2c517d549d1 2023-03-20 10:55:50,264 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/13a6c80b93064b43bd18914ff051a924 2023-03-20 10:55:50,269 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13a6c80b93064b43bd18914ff051a924 2023-03-20 10:55:50,273 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b8c3605fbc14270a54f3dad08a381ed 2023-03-20 10:55:50,273 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/9b8c3605fbc14270a54f3dad08a381ed, entries=3, sequenceid=23, filesize=5.0 K 2023-03-20 10:55:50,274 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c66a66eb629b46169992a2c517d549d1 2023-03-20 10:55:50,274 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/c66a66eb629b46169992a2c517d549d1, entries=1, sequenceid=23, filesize=5.0 K 2023-03-20 10:55:50,275 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/b37dc711248c4c4d88f9c79e2096a5d9 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/b37dc711248c4c4d88f9c79e2096a5d9 2023-03-20 10:55:50,275 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for af00e67c6039a735f18797dedd567132 in 1276ms, sequenceid=23, compaction requested=true 2023-03-20 10:55:50,275 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:50,275 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:50,275 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:55:50,284 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/fa03d26382c3411e967cb7558ac24cdd as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/fa03d26382c3411e967cb7558ac24cdd 2023-03-20 10:55:50,295 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b37dc711248c4c4d88f9c79e2096a5d9 2023-03-20 10:55:50,295 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/b37dc711248c4c4d88f9c79e2096a5d9, entries=3, sequenceid=23, filesize=5.0 K 2023-03-20 10:55:50,296 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/13a6c80b93064b43bd18914ff051a924 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/13a6c80b93064b43bd18914ff051a924 2023-03-20 10:55:50,302 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa03d26382c3411e967cb7558ac24cdd 2023-03-20 10:55:50,302 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/fa03d26382c3411e967cb7558ac24cdd, entries=1, sequenceid=23, filesize=5.0 K 2023-03-20 10:55:50,303 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d6d1d1bb207a093cc32d1ceea5d628b3 in 1304ms, sequenceid=23, compaction requested=true 2023-03-20 10:55:50,303 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:50,303 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:50,303 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:55:50,316 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13a6c80b93064b43bd18914ff051a924 2023-03-20 10:55:50,317 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/13a6c80b93064b43bd18914ff051a924, entries=1, sequenceid=23, filesize=5.0 K 2023-03-20 10:55:50,318 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a5a7eb0c16894ccc2304d0ab4b06501b in 1319ms, sequenceid=23, compaction requested=true 2023-03-20 10:55:50,318 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:50,318 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:50,318 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:55:50,318 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:55:50,319 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,319 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-20 10:55:50,319 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-20 10:55:50,320 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,320 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,321 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,321 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:50,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-20 10:55:50,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1005a77d[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:50,324 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-20 10:55:50,324 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,327 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-20 10:55:50,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-20 10:55:50,327 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:50,327 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,327 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:50,339 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,339 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-20 10:55:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:50,339 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:50,340 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-20 10:55:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-20 10:55:50,344 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-20 10:55:50,344 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:50,344 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:50,344 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-20 10:55:50,344 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:50,348 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,348 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:50,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,348 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:50,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:50,349 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:50,350 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-20 10:55:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:50,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:50,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:50,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-20 10:55:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:50,351 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:50,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-20 10:55:50,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:50,351 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:50,352 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,352 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-20 10:55:50,352 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-20 10:55:50,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:50,352 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:50,352 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:50,452 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:50,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:50,453 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:50,453 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): af00e67c6039a735f18797dedd567132/family1 is initiating major compaction (all files) 2023-03-20 10:55:50,454 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:50,454 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:50,454 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of af00e67c6039a735f18797dedd567132/family1 in ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:50,454 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/ffb023824a0846a58ca452fbbeba048b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/016c1407dbf64fc5bc1b5cdd424b5139, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/fe5c88baccd8493c9443e77441e81aef, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/7864f5bd84be427ba02f3280148c6e0f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/c3c91e799ab8463fbe6d79af6b3ee54e] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp, totalSize=26.6 K 2023-03-20 10:55:50,455 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting ffb023824a0846a58ca452fbbeba048b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309742130 2023-03-20 10:55:50,455 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 016c1407dbf64fc5bc1b5cdd424b5139, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309743927 2023-03-20 10:55:50,456 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting fe5c88baccd8493c9443e77441e81aef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309745328 2023-03-20 10:55:50,456 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 7864f5bd84be427ba02f3280148c6e0f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309747131 2023-03-20 10:55:50,457 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting c3c91e799ab8463fbe6d79af6b3ee54e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:55:50,487 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): af00e67c6039a735f18797dedd567132#family1#compaction#150 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:50,923 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303209622fc3103d94fabb4cfdaeb42b31afc_del 2023-03-20 10:55:50,923 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303209622fc3103d94fabb4cfdaeb42b31afc_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303209622fc3103d94fabb4cfdaeb42b31afc_del 2023-03-20 10:55:51,346 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29f8d21b86704ee59f7adab931e0f1aa 2023-03-20 10:55:51,347 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family1/29f8d21b86704ee59f7adab931e0f1aa as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/29f8d21b86704ee59f7adab931e0f1aa 2023-03-20 10:55:51,351 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29f8d21b86704ee59f7adab931e0f1aa 2023-03-20 10:55:51,352 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in af00e67c6039a735f18797dedd567132/family1 of af00e67c6039a735f18797dedd567132 into 29f8d21b86704ee59f7adab931e0f1aa(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:51,352 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:51,352 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:51,352 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): af00e67c6039a735f18797dedd567132/family2 is initiating major compaction (all files) 2023-03-20 10:55:51,353 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:51,353 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:51,354 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of af00e67c6039a735f18797dedd567132/family2 in ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:55:51,354 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/d3432c0f94934c998dbbeae5e3eaa9ab, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/24fb8253596d4560b3215659099ae4bc, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/3783690295034c4e9eaf6b734be0cc40, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/0bcb76c05d0646d2bb4caec8c970a015, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/c66a66eb629b46169992a2c517d549d1] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp, totalSize=25.3 K 2023-03-20 10:55:51,355 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting d3432c0f94934c998dbbeae5e3eaa9ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309742130 2023-03-20 10:55:51,355 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 24fb8253596d4560b3215659099ae4bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309743927 2023-03-20 10:55:51,355 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3783690295034c4e9eaf6b734be0cc40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309745328 2023-03-20 10:55:51,356 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 0bcb76c05d0646d2bb4caec8c970a015, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309747131 2023-03-20 10:55:51,356 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting c66a66eb629b46169992a2c517d549d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:55:51,381 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): af00e67c6039a735f18797dedd567132#family2#compaction#151 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:51,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/ffb023824a0846a58ca452fbbeba048b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/016c1407dbf64fc5bc1b5cdd424b5139, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/fe5c88baccd8493c9443e77441e81aef, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/7864f5bd84be427ba02f3280148c6e0f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/c3c91e799ab8463fbe6d79af6b3ee54e] to archive 2023-03-20 10:55:51,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:51,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/ffb023824a0846a58ca452fbbeba048b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/ffb023824a0846a58ca452fbbeba048b 2023-03-20 10:55:51,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/016c1407dbf64fc5bc1b5cdd424b5139 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/016c1407dbf64fc5bc1b5cdd424b5139 2023-03-20 10:55:51,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/fe5c88baccd8493c9443e77441e81aef to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/fe5c88baccd8493c9443e77441e81aef 2023-03-20 10:55:51,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/7864f5bd84be427ba02f3280148c6e0f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/7864f5bd84be427ba02f3280148c6e0f 2023-03-20 10:55:51,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/c3c91e799ab8463fbe6d79af6b3ee54e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/c3c91e799ab8463fbe6d79af6b3ee54e 2023-03-20 10:55:51,793 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230320c8ba101d3b1c408ebf35fcac55e2cfe6_del 2023-03-20 10:55:51,793 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320c8ba101d3b1c408ebf35fcac55e2cfe6_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230320c8ba101d3b1c408ebf35fcac55e2cfe6_del 2023-03-20 10:55:52,208 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddd06677ee5f40739350e5fe462a0017 2023-03-20 10:55:52,209 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/.tmp/family2/ddd06677ee5f40739350e5fe462a0017 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/ddd06677ee5f40739350e5fe462a0017 2023-03-20 10:55:52,213 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddd06677ee5f40739350e5fe462a0017 2023-03-20 10:55:52,214 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in af00e67c6039a735f18797dedd567132/family2 of af00e67c6039a735f18797dedd567132 into ddd06677ee5f40739350e5fe462a0017(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:52,215 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:52,215 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:52,215 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): d6d1d1bb207a093cc32d1ceea5d628b3/family1 is initiating major compaction (all files) 2023-03-20 10:55:52,215 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:52,215 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:52,215 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of d6d1d1bb207a093cc32d1ceea5d628b3/family1 in ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:52,215 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/36fb5efd448349f88371045ff213a1f8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/df87d8ca97e1494284f12fe701331e83, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/3a908902e9c8484a8abea94ec54425c5, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/8d184e3095c14ab1ad4b15ce65942ef5, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/9b8c3605fbc14270a54f3dad08a381ed] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp, totalSize=26.6 K 2023-03-20 10:55:52,216 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 36fb5efd448349f88371045ff213a1f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309742129 2023-03-20 10:55:52,216 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting df87d8ca97e1494284f12fe701331e83, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309743927 2023-03-20 10:55:52,217 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3a908902e9c8484a8abea94ec54425c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309745328 2023-03-20 10:55:52,217 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 8d184e3095c14ab1ad4b15ce65942ef5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309747131 2023-03-20 10:55:52,217 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 9b8c3605fbc14270a54f3dad08a381ed, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:55:52,227 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): d6d1d1bb207a093cc32d1ceea5d628b3#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:52,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/d3432c0f94934c998dbbeae5e3eaa9ab, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/24fb8253596d4560b3215659099ae4bc, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/3783690295034c4e9eaf6b734be0cc40, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/0bcb76c05d0646d2bb4caec8c970a015, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/c66a66eb629b46169992a2c517d549d1] to archive 2023-03-20 10:55:52,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:52,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/d3432c0f94934c998dbbeae5e3eaa9ab to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/d3432c0f94934c998dbbeae5e3eaa9ab 2023-03-20 10:55:52,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/24fb8253596d4560b3215659099ae4bc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/24fb8253596d4560b3215659099ae4bc 2023-03-20 10:55:52,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/3783690295034c4e9eaf6b734be0cc40 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/3783690295034c4e9eaf6b734be0cc40 2023-03-20 10:55:52,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/0bcb76c05d0646d2bb4caec8c970a015 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/0bcb76c05d0646d2bb4caec8c970a015 2023-03-20 10:55:52,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/c66a66eb629b46169992a2c517d549d1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family2/c66a66eb629b46169992a2c517d549d1 2023-03-20 10:55:52,643 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303203235923402964ddb8d7a6d808f6be034_del 2023-03-20 10:55:52,644 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303203235923402964ddb8d7a6d808f6be034_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303203235923402964ddb8d7a6d808f6be034_del 2023-03-20 10:55:53,460 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a61c7de053147d393c1e8212bbcd72e 2023-03-20 10:55:53,461 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family1/2a61c7de053147d393c1e8212bbcd72e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/2a61c7de053147d393c1e8212bbcd72e 2023-03-20 10:55:53,466 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a61c7de053147d393c1e8212bbcd72e 2023-03-20 10:55:53,468 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d6d1d1bb207a093cc32d1ceea5d628b3/family1 of d6d1d1bb207a093cc32d1ceea5d628b3 into 2a61c7de053147d393c1e8212bbcd72e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:55:53,468 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:53,468 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:53,468 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): d6d1d1bb207a093cc32d1ceea5d628b3/family2 is initiating major compaction (all files) 2023-03-20 10:55:53,469 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:53,469 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:53,469 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of d6d1d1bb207a093cc32d1ceea5d628b3/family2 in ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:55:53,469 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/bc6bfeff5f89454eba24fb37097e873c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/4618e0729a3f4033b38e3772523eee61, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/742fcdf17472459b8c6d00908dc687b6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/a676f503e73f426d84f7bdaa35e3407c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/fa03d26382c3411e967cb7558ac24cdd] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp, totalSize=25.3 K 2023-03-20 10:55:53,470 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting bc6bfeff5f89454eba24fb37097e873c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309742129 2023-03-20 10:55:53,470 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 4618e0729a3f4033b38e3772523eee61, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309743927 2023-03-20 10:55:53,470 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 742fcdf17472459b8c6d00908dc687b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309745328 2023-03-20 10:55:53,473 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting a676f503e73f426d84f7bdaa35e3407c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309747131 2023-03-20 10:55:53,474 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting fa03d26382c3411e967cb7558ac24cdd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:55:53,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/36fb5efd448349f88371045ff213a1f8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/df87d8ca97e1494284f12fe701331e83, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/3a908902e9c8484a8abea94ec54425c5, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/8d184e3095c14ab1ad4b15ce65942ef5, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/9b8c3605fbc14270a54f3dad08a381ed] to archive 2023-03-20 10:55:53,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:53,499 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): d6d1d1bb207a093cc32d1ceea5d628b3#family2#compaction#153 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:53,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/36fb5efd448349f88371045ff213a1f8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/36fb5efd448349f88371045ff213a1f8 2023-03-20 10:55:53,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/df87d8ca97e1494284f12fe701331e83 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/df87d8ca97e1494284f12fe701331e83 2023-03-20 10:55:53,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/3a908902e9c8484a8abea94ec54425c5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/3a908902e9c8484a8abea94ec54425c5 2023-03-20 10:55:53,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/8d184e3095c14ab1ad4b15ce65942ef5 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/8d184e3095c14ab1ad4b15ce65942ef5 2023-03-20 10:55:53,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/9b8c3605fbc14270a54f3dad08a381ed to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/9b8c3605fbc14270a54f3dad08a381ed 2023-03-20 10:55:53,926 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023032094c0cb51eb794cc08202fdb181691ecf_del 2023-03-20 10:55:53,926 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032094c0cb51eb794cc08202fdb181691ecf_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023032094c0cb51eb794cc08202fdb181691ecf_del 2023-03-20 10:55:54,349 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 663da250a52b4775ae33348ab50911b1 2023-03-20 10:55:54,350 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/.tmp/family2/663da250a52b4775ae33348ab50911b1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/663da250a52b4775ae33348ab50911b1 2023-03-20 10:55:54,355 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 663da250a52b4775ae33348ab50911b1 2023-03-20 10:55:54,356 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d6d1d1bb207a093cc32d1ceea5d628b3/family2 of d6d1d1bb207a093cc32d1ceea5d628b3 into 663da250a52b4775ae33348ab50911b1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:54,356 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:54,356 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:54,356 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): a5a7eb0c16894ccc2304d0ab4b06501b/family1 is initiating major compaction (all files) 2023-03-20 10:55:54,357 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:54,357 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:54,357 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of a5a7eb0c16894ccc2304d0ab4b06501b/family1 in ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:54,358 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/6ee26674c6904f0f81d9b3eedc3bab2c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/d2260da2951a463b89a401c2818c65ad, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/07dec093eb0e4246b82807e7c1d910dc, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/77f6110a2719403696040a7c02652fa7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/b37dc711248c4c4d88f9c79e2096a5d9] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp, totalSize=26.6 K 2023-03-20 10:55:54,358 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 6ee26674c6904f0f81d9b3eedc3bab2c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309742128 2023-03-20 10:55:54,359 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting d2260da2951a463b89a401c2818c65ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309743927 2023-03-20 10:55:54,369 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 07dec093eb0e4246b82807e7c1d910dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309745328 2023-03-20 10:55:54,371 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 77f6110a2719403696040a7c02652fa7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309747131 2023-03-20 10:55:54,372 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting b37dc711248c4c4d88f9c79e2096a5d9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:55:54,392 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): a5a7eb0c16894ccc2304d0ab4b06501b#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:54,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/bc6bfeff5f89454eba24fb37097e873c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/4618e0729a3f4033b38e3772523eee61, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/742fcdf17472459b8c6d00908dc687b6, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/a676f503e73f426d84f7bdaa35e3407c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/fa03d26382c3411e967cb7558ac24cdd] to archive 2023-03-20 10:55:54,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:54,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/bc6bfeff5f89454eba24fb37097e873c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/bc6bfeff5f89454eba24fb37097e873c 2023-03-20 10:55:54,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/4618e0729a3f4033b38e3772523eee61 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/4618e0729a3f4033b38e3772523eee61 2023-03-20 10:55:54,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/742fcdf17472459b8c6d00908dc687b6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/742fcdf17472459b8c6d00908dc687b6 2023-03-20 10:55:54,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/a676f503e73f426d84f7bdaa35e3407c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/a676f503e73f426d84f7bdaa35e3407c 2023-03-20 10:55:54,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/fa03d26382c3411e967cb7558ac24cdd to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family2/fa03d26382c3411e967cb7558ac24cdd 2023-03-20 10:55:54,807 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320e53a33c651eb4770a996614d2b005ef3_del 2023-03-20 10:55:54,807 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320e53a33c651eb4770a996614d2b005ef3_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230320e53a33c651eb4770a996614d2b005ef3_del 2023-03-20 10:55:55,267 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2193a8b9621b4cf48f2348b70b60c887 2023-03-20 10:55:55,268 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family1/2193a8b9621b4cf48f2348b70b60c887 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/2193a8b9621b4cf48f2348b70b60c887 2023-03-20 10:55:55,277 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2193a8b9621b4cf48f2348b70b60c887 2023-03-20 10:55:55,278 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a5a7eb0c16894ccc2304d0ab4b06501b/family1 of a5a7eb0c16894ccc2304d0ab4b06501b into 2193a8b9621b4cf48f2348b70b60c887(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:55,278 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:55,278 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:55:55,279 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): a5a7eb0c16894ccc2304d0ab4b06501b/family2 is initiating major compaction (all files) 2023-03-20 10:55:55,279 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:55:55,279 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:55:55,280 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of a5a7eb0c16894ccc2304d0ab4b06501b/family2 in ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:55:55,280 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/386cbae8a55b4c23a111de3c09eda37e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/3be25a917b154cad9009f003761e77ce, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/0cea67b54b36446ea7b2f34dd8942e3c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/13a6c80b93064b43bd18914ff051a924] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp, totalSize=25.3 K 2023-03-20 10:55:55,280 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 386cbae8a55b4c23a111de3c09eda37e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309742128 2023-03-20 10:55:55,282 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3be25a917b154cad9009f003761e77ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309743927 2023-03-20 10:55:55,282 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 0cea67b54b36446ea7b2f34dd8942e3c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309745328 2023-03-20 10:55:55,283 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 2a6e25b1e64a432fa8e6b0bae31dbb7e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309747131 2023-03-20 10:55:55,283 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 13a6c80b93064b43bd18914ff051a924, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:55:55,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/6ee26674c6904f0f81d9b3eedc3bab2c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/d2260da2951a463b89a401c2818c65ad, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/07dec093eb0e4246b82807e7c1d910dc, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/77f6110a2719403696040a7c02652fa7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/b37dc711248c4c4d88f9c79e2096a5d9] to archive 2023-03-20 10:55:55,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:55,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/6ee26674c6904f0f81d9b3eedc3bab2c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/6ee26674c6904f0f81d9b3eedc3bab2c 2023-03-20 10:55:55,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/d2260da2951a463b89a401c2818c65ad to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/d2260da2951a463b89a401c2818c65ad 2023-03-20 10:55:55,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/07dec093eb0e4246b82807e7c1d910dc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/07dec093eb0e4246b82807e7c1d910dc 2023-03-20 10:55:55,306 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): a5a7eb0c16894ccc2304d0ab4b06501b#family2#compaction#155 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:55:55,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/77f6110a2719403696040a7c02652fa7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/77f6110a2719403696040a7c02652fa7 2023-03-20 10:55:55,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/b37dc711248c4c4d88f9c79e2096a5d9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/b37dc711248c4c4d88f9c79e2096a5d9 2023-03-20 10:55:55,723 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320f12a091a9de14425bd702e200a0d402a_del 2023-03-20 10:55:55,723 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320f12a091a9de14425bd702e200a0d402a_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230320f12a091a9de14425bd702e200a0d402a_del 2023-03-20 10:55:56,138 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9acbb163f1348fbb8d9a41440cabc52 2023-03-20 10:55:56,139 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/.tmp/family2/c9acbb163f1348fbb8d9a41440cabc52 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/c9acbb163f1348fbb8d9a41440cabc52 2023-03-20 10:55:56,143 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9acbb163f1348fbb8d9a41440cabc52 2023-03-20 10:55:56,144 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a5a7eb0c16894ccc2304d0ab4b06501b/family2 of a5a7eb0c16894ccc2304d0ab4b06501b into c9acbb163f1348fbb8d9a41440cabc52(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:55:56,144 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:56,148 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:56,150 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:56,154 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:56,155 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:56,161 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-20 10:55:56,178 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-20 10:55:56,192 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320e53a33c651eb4770a996614d2b005ef3_del 2023-03-20 10:55:56,196 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303203235923402964ddb8d7a6d808f6be034_del 2023-03-20 10:55:56,201 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303209622fc3103d94fabb4cfdaeb42b31afc_del 2023-03-20 10:55:56,201 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:56,202 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(139): Connect 0x0ce88277 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:55:56,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/386cbae8a55b4c23a111de3c09eda37e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/3be25a917b154cad9009f003761e77ce, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/0cea67b54b36446ea7b2f34dd8942e3c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/13a6c80b93064b43bd18914ff051a924] to archive 2023-03-20 10:55:56,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:56,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/386cbae8a55b4c23a111de3c09eda37e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/386cbae8a55b4c23a111de3c09eda37e 2023-03-20 10:55:56,211 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72a8fcad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:55:56,213 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230320 for table='ns:testMinorCompaction' and column='family1' 2023-03-20 10:55:56,213 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230320 for table='ns:testMinorCompaction' and column='family1' 2023-03-20 10:55:56,213 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230320 for table='ns:testMinorCompaction' and column='family1' 2023-03-20 10:55:56,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/3be25a917b154cad9009f003761e77ce to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/3be25a917b154cad9009f003761e77ce 2023-03-20 10:55:56,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/0cea67b54b36446ea7b2f34dd8942e3c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/0cea67b54b36446ea7b2f34dd8942e3c 2023-03-20 10:55:56,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/2a6e25b1e64a432fa8e6b0bae31dbb7e 2023-03-20 10:55:56,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/13a6c80b93064b43bd18914ff051a924 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family2/13a6c80b93064b43bd18914ff051a924 2023-03-20 10:55:56,653 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032015823ac9191a432b960d262dd79dd2bd to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023032015823ac9191a432b960d262dd79dd2bd 2023-03-20 10:55:56,654 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303203765db6512cc4d0bbc57c5bae188c2c2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303203765db6512cc4d0bbc57c5bae188c2c2 2023-03-20 10:55:56,654 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:56,655 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:56,667 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:55:56,671 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48160, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:55:56,685 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:55:56,699 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:55:56,738 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230320/family1/f3702a8046bc4c5c901e0d35a2a0cc1c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-20 10:55:56,739 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230320/family1/f3702a8046bc4c5c901e0d35a2a0cc1c}] 2023-03-20 10:55:56,745 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230320/family1/f3702a8046bc4c5c901e0d35a2a0cc1c for inclusion in d6d1d1bb207a093cc32d1ceea5d628b3/family1 2023-03-20 10:55:56,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-20 10:55:56,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-20 10:55:56,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:55:56,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230320/family1/f3702a8046bc4c5c901e0d35a2a0cc1c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__f1v3o5eaki14nu4pql1he0lkmp5gik8c1d1siuf5cutij79cqfst45gt5bs3smio/family1/f3702a8046bc4c5c901e0d35a2a0cc1c 2023-03-20 10:55:56,751 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/family1/c91d7f63813344f2a0872c7f061e22b2 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-20 10:55:56,752 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/family1/c91d7f63813344f2a0872c7f061e22b2}] 2023-03-20 10:55:56,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/family1/c91d7f63813344f2a0872c7f061e22b2 for inclusion in a5a7eb0c16894ccc2304d0ab4b06501b/family1 2023-03-20 10:55:56,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__f1v3o5eaki14nu4pql1he0lkmp5gik8c1d1siuf5cutij79cqfst45gt5bs3smio/family1/f3702a8046bc4c5c901e0d35a2a0cc1c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/730e395f786041c8849dc179730fa8d9_SeqId_28_ 2023-03-20 10:55:56,760 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__f1v3o5eaki14nu4pql1he0lkmp5gik8c1d1siuf5cutij79cqfst45gt5bs3smio/family1/f3702a8046bc4c5c901e0d35a2a0cc1c into d6d1d1bb207a093cc32d1ceea5d628b3/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/730e395f786041c8849dc179730fa8d9_SeqId_28_ - updating store file list. 2023-03-20 10:55:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-20 10:55:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last=1 2023-03-20 10:55:56,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:55:56,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230320/family1/c91d7f63813344f2a0872c7f061e22b2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__qpsem8o8an818d60sncdk2td2kboeuik3csguf1tsmk5bp1t1b6si7r5jth0p83t/family1/c91d7f63813344f2a0872c7f061e22b2 2023-03-20 10:55:56,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__qpsem8o8an818d60sncdk2td2kboeuik3csguf1tsmk5bp1t1b6si7r5jth0p83t/family1/c91d7f63813344f2a0872c7f061e22b2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/bc8466b650b344ad87c2756fbf8eb17e_SeqId_28_ 2023-03-20 10:55:56,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__qpsem8o8an818d60sncdk2td2kboeuik3csguf1tsmk5bp1t1b6si7r5jth0p83t/family1/c91d7f63813344f2a0872c7f061e22b2 into a5a7eb0c16894ccc2304d0ab4b06501b/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/bc8466b650b344ad87c2756fbf8eb17e_SeqId_28_ - updating store file list. 2023-03-20 10:55:56,766 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/730e395f786041c8849dc179730fa8d9_SeqId_28_ into d6d1d1bb207a093cc32d1ceea5d628b3/family1 2023-03-20 10:55:56,766 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__f1v3o5eaki14nu4pql1he0lkmp5gik8c1d1siuf5cutij79cqfst45gt5bs3smio/family1/f3702a8046bc4c5c901e0d35a2a0cc1c into d6d1d1bb207a093cc32d1ceea5d628b3/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/family1/730e395f786041c8849dc179730fa8d9_SeqId_28_) 2023-03-20 10:55:56,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__f1v3o5eaki14nu4pql1he0lkmp5gik8c1d1siuf5cutij79cqfst45gt5bs3smio/family1/f3702a8046bc4c5c901e0d35a2a0cc1c 2023-03-20 10:55:56,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/bc8466b650b344ad87c2756fbf8eb17e_SeqId_28_ into a5a7eb0c16894ccc2304d0ab4b06501b/family1 2023-03-20 10:55:56,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__qpsem8o8an818d60sncdk2td2kboeuik3csguf1tsmk5bp1t1b6si7r5jth0p83t/family1/c91d7f63813344f2a0872c7f061e22b2 into a5a7eb0c16894ccc2304d0ab4b06501b/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/family1/bc8466b650b344ad87c2756fbf8eb17e_SeqId_28_) 2023-03-20 10:55:56,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__qpsem8o8an818d60sncdk2td2kboeuik3csguf1tsmk5bp1t1b6si7r5jth0p83t/family1/c91d7f63813344f2a0872c7f061e22b2 2023-03-20 10:55:56,771 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:56,772 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:56,774 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:56,774 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230320fd51b5d439384dc3836d819268dddace to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230320fd51b5d439384dc3836d819268dddace 2023-03-20 10:55:56,774 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-20 10:55:56,774 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230320' 2023-03-20 10:55:56,783 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:56,784 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230320 for table='ns:testMinorCompaction' and column='family1' 2023-03-20 10:55:56,792 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230320ee93909fc89848e79188593d0407b994 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230320ee93909fc89848e79188593d0407b994 2023-03-20 10:55:56,792 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-20 10:55:56,792 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230320' 2023-03-20 10:55:56,793 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230320 for table='ns:testMinorCompaction' and column='family1' 2023-03-20 10:55:57,056 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032011ba986a11034649877206660fa39433 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023032011ba986a11034649877206660fa39433 2023-03-20 10:55:57,057 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:57,103 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230320/family1/acc64f9782f64a9fb86204fe30f631fc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-20 10:55:57,107 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230320/family1/acc64f9782f64a9fb86204fe30f631fc}] 2023-03-20 10:55:57,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230320/family1/acc64f9782f64a9fb86204fe30f631fc for inclusion in af00e67c6039a735f18797dedd567132/family1 2023-03-20 10:55:57,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-20 10:55:57,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-20 10:55:57,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:55:57,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230320/family1/acc64f9782f64a9fb86204fe30f631fc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__nvqm61tr6rlgrbuuqsgb5infk8c1b8p8gosf937ublrpads714rbcatlmi0718lq/family1/acc64f9782f64a9fb86204fe30f631fc 2023-03-20 10:55:57,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__nvqm61tr6rlgrbuuqsgb5infk8c1b8p8gosf937ublrpads714rbcatlmi0718lq/family1/acc64f9782f64a9fb86204fe30f631fc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/f950a32262764c12b99c9a6b6201114d_SeqId_28_ 2023-03-20 10:55:57,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__nvqm61tr6rlgrbuuqsgb5infk8c1b8p8gosf937ublrpads714rbcatlmi0718lq/family1/acc64f9782f64a9fb86204fe30f631fc into af00e67c6039a735f18797dedd567132/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/f950a32262764c12b99c9a6b6201114d_SeqId_28_ - updating store file list. 2023-03-20 10:55:57,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/f950a32262764c12b99c9a6b6201114d_SeqId_28_ into af00e67c6039a735f18797dedd567132/family1 2023-03-20 10:55:57,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__nvqm61tr6rlgrbuuqsgb5infk8c1b8p8gosf937ublrpads714rbcatlmi0718lq/family1/acc64f9782f64a9fb86204fe30f631fc into af00e67c6039a735f18797dedd567132/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/family1/f950a32262764c12b99c9a6b6201114d_SeqId_28_) 2023-03-20 10:55:57,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__ns_testMinorCompaction__nvqm61tr6rlgrbuuqsgb5infk8c1b8p8gosf937ublrpads714rbcatlmi0718lq/family1/acc64f9782f64a9fb86204fe30f631fc 2023-03-20 10:55:57,126 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:57,127 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:55:57,129 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230320e13fb74ec09d4f08a590c44b52fc05cc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230320e13fb74ec09d4f08a590c44b52fc05cc 2023-03-20 10:55:57,130 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-20 10:55:57,130 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230320' 2023-03-20 10:55:57,130 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230320 for table='ns:testMinorCompaction' and column='family1' 2023-03-20 10:55:57,130 INFO [Listener at localhost.localdomain/43657] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-20 10:55:57,132 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:57,135 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:57,138 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:55:57,139 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:55:57,164 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=247 (was 286), OpenFileDescriptor=622 (was 762), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=447 (was 372) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 187) - ProcessCount LEAK? -, AvailableMemoryMB=8577 (was 8712) 2023-03-20 10:55:57,176 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=447, ProcessCount=192, AvailableMemoryMB=8576 2023-03-20 10:55:57,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-20 10:55:57,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:57,182 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:55:57,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-20 10:55:57,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:55:57,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-20 10:55:57,184 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,184 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68 empty. 2023-03-20 10:55:57,185 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,185 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-20 10:55:57,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-20 10:55:57,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-20 10:55:57,595 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-20 10:55:57,596 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e274008ba03fba13d08e97b9fc403e68, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:55:57,617 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:57,617 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing e274008ba03fba13d08e97b9fc403e68, disabling compactions & flushes 2023-03-20 10:55:57,617 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,617 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,617 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. after waiting 0 ms 2023-03-20 10:55:57,617 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,618 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,618 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:55:57,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:55:57,624 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679309757624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309757624"}]},"ts":"1679309757624"} 2023-03-20 10:55:57,626 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-20 10:55:57,627 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:55:57,627 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309757627"}]},"ts":"1679309757627"} 2023-03-20 10:55:57,628 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-20 10:55:57,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e274008ba03fba13d08e97b9fc403e68, ASSIGN}] 2023-03-20 10:55:57,631 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e274008ba03fba13d08e97b9fc403e68, ASSIGN 2023-03-20 10:55:57,632 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e274008ba03fba13d08e97b9fc403e68, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:55:57,783 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=e274008ba03fba13d08e97b9fc403e68, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:57,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679309757783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309757783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309757783"}]},"ts":"1679309757783"} 2023-03-20 10:55:57,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure e274008ba03fba13d08e97b9fc403e68, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:55:57,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-20 10:55:57,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e274008ba03fba13d08e97b9fc403e68, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.', STARTKEY => '', ENDKEY => ''} 2023-03-20 10:55:57,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:55:57,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,941 INFO [StoreOpener-e274008ba03fba13d08e97b9fc403e68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,942 DEBUG [StoreOpener-e274008ba03fba13d08e97b9fc403e68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:55:57,942 DEBUG [StoreOpener-e274008ba03fba13d08e97b9fc403e68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:55:57,943 INFO [StoreOpener-e274008ba03fba13d08e97b9fc403e68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e274008ba03fba13d08e97b9fc403e68 columnFamilyName family1 2023-03-20 10:55:57,945 INFO [StoreOpener-e274008ba03fba13d08e97b9fc403e68-1] regionserver.HStore(310): Store=e274008ba03fba13d08e97b9fc403e68/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:55:57,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:55:57,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:55:57,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e274008ba03fba13d08e97b9fc403e68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69679098, jitterRate=0.03829947113990784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-20 10:55:57,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:55:57,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68., pid=114, masterSystemTime=1679309757936 2023-03-20 10:55:57,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:57,955 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=e274008ba03fba13d08e97b9fc403e68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:57,955 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679309757955"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309757955"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309757955"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309757955"}]},"ts":"1679309757955"} 2023-03-20 10:55:57,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-20 10:55:57,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure e274008ba03fba13d08e97b9fc403e68, server=jenkins-hbase20.apache.org,44189,1679309623230 in 172 msec 2023-03-20 10:55:57,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-20 10:55:57,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e274008ba03fba13d08e97b9fc403e68, ASSIGN in 328 msec 2023-03-20 10:55:57,960 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:55:57,960 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309757960"}]},"ts":"1679309757960"} 2023-03-20 10:55:57,960 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-20 10:55:57,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:55:57,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 784 msec 2023-03-20 10:55:58,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-20 10:55:58,288 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-20 10:55:58,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:58,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,409 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:58,409 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:58,409 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:55:58,409 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:55:58,411 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,411 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,418 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,418 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:58,419 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,419 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:58,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:58,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,421 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,422 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:55:58,422 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:58,422 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:55:58,429 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:58,429 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:58,429 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:58,429 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:55:58,430 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-20 10:55:58,884 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b4a8c8cefd494e989422959dbc2a36dd to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b4a8c8cefd494e989422959dbc2a36dd 2023-03-20 10:55:58,887 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/8df722be1c694114b9730e43c9a19870 2023-03-20 10:55:58,890 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/8df722be1c694114b9730e43c9a19870 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/8df722be1c694114b9730e43c9a19870 2023-03-20 10:55:58,894 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/8df722be1c694114b9730e43c9a19870, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-20 10:55:58,895 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 465ms, sequenceid=5, compaction requested=false 2023-03-20 10:55:58,895 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:58,895 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:55:58,895 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:58,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:58,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:58,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:55:58,896 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:55:58,897 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,897 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:58,897 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,897 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:58,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:58,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:55:58,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@225c997d[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:58,900 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:55:58,900 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,902 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,902 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,902 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:58,902 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:55:58,902 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:55:58,902 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:58,931 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,931 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:55:58,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:58,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:58,931 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:58,932 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:55:58,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:58,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:58,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:58,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:58,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:55:58,935 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:55:58,935 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:58,935 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:58,935 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,935 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:58,955 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,955 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:58,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:58,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:58,956 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:58,956 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:58,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,957 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:58,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:58,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:58,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:58,963 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:58,963 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,964 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:58,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:58,964 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:59,064 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:59,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:59,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:59,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:59,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,070 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:59,070 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:59,070 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:55:59,070 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:55:59,070 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,070 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,071 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:59,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:59,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:59,071 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,072 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,072 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:59,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,073 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:55:59,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,073 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:55:59,073 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:59,073 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:55:59,073 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:59,073 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:59,073 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:59,073 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:55:59,073 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-20 10:55:59,090 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e964dbebddd345668230327496c4f448 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e964dbebddd345668230327496c4f448 2023-03-20 10:55:59,099 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/dc3275a80e88430d99757f84001a0d81 2023-03-20 10:55:59,103 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/dc3275a80e88430d99757f84001a0d81 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/dc3275a80e88430d99757f84001a0d81 2023-03-20 10:55:59,106 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/dc3275a80e88430d99757f84001a0d81, entries=1, sequenceid=9, filesize=5.0 K 2023-03-20 10:55:59,107 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 34ms, sequenceid=9, compaction requested=false 2023-03-20 10:55:59,108 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:55:59,108 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:59,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:59,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:59,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:55:59,108 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:55:59,109 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,109 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:59,109 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,109 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:59,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:55:59,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@91693b4[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:59,118 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:55:59,119 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,122 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,123 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:55:59,123 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:55:59,123 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:59,123 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,123 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:59,131 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,131 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:55:59,131 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:59,131 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:59,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:55:59,137 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:55:59,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:59,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:59,137 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,137 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:59,139 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,139 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:59,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,139 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:59,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:59,140 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,141 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,145 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:59,145 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:59,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:59,145 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:59,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:55:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:59,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:59,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:59,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:59,145 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:59,145 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,146 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,246 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:59,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:59,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:59,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:59,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,252 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:59,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:59,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:55:59,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:55:59,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,252 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,253 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,253 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:59,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:59,253 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,253 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:55:59,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,256 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:55:59,257 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:59,257 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:55:59,257 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:59,257 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:59,257 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:59,257 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:55:59,257 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:55:59,267 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a283875888344f06bc83e044cea9f7e4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201a283875888344f06bc83e044cea9f7e4 2023-03-20 10:55:59,677 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/e0edc449c1b9472e8da214d8433473e3 2023-03-20 10:55:59,686 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/e0edc449c1b9472e8da214d8433473e3 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/e0edc449c1b9472e8da214d8433473e3 2023-03-20 10:55:59,693 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/e0edc449c1b9472e8da214d8433473e3, entries=1, sequenceid=13, filesize=4.9 K 2023-03-20 10:55:59,694 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 437ms, sequenceid=13, compaction requested=true 2023-03-20 10:55:59,694 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:55:59,694 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:59,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:55:59,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:55:59,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:55:59,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:55:59,696 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,696 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:59,697 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,697 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:55:59,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:59,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:59,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:55:59,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f47649a[Count = 0] remaining members to acquire global barrier 2023-03-20 10:55:59,699 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:55:59,699 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,700 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,700 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:55:59,700 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:55:59,700 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:55:59,700 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,700 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:55:59,701 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:55:59,701 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:59,701 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:55:59,701 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:59,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:59,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:59,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:59,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:55:59,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:55:59,704 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:55:59,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:55:59,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:55:59,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,705 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:55:59,714 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,714 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:55:59,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:55:59,714 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:59,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:59,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:59,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:55:59,716 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:55:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,717 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:55:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,722 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:59,722 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,723 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:55:59,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:59,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:55:59,723 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:59,723 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:55:59,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:55:59,723 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:55:59,724 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:55:59,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:55:59,723 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:55:59,724 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,724 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,724 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,724 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,824 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:55:59,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:55:59,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:55:59,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:55:59,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,840 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:55:59,840 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:59,840 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:55:59,840 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:55:59,841 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,841 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,841 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:55:59,841 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:55:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:55:59,842 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:55:59,842 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:55:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:55:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,843 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:55:59,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:55:59,843 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:55:59,843 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:55:59,843 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:55:59,843 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:55:59,843 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:55:59,843 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:55:59,844 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:55:59,844 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:00,262 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120534b3b2d8ec754c1998108a3137dafdae to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120534b3b2d8ec754c1998108a3137dafdae 2023-03-20 10:56:00,671 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/55882e5551f54eb691027dd847794191 2023-03-20 10:56:00,680 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/55882e5551f54eb691027dd847794191 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/55882e5551f54eb691027dd847794191 2023-03-20 10:56:00,688 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/55882e5551f54eb691027dd847794191, entries=1, sequenceid=17, filesize=4.9 K 2023-03-20 10:56:00,689 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 845ms, sequenceid=17, compaction requested=true 2023-03-20 10:56:00,689 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:00,689 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:00,689 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:00,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:00,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:00,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:00,691 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,691 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:00,692 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,692 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:00,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:00,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a4f58c9[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:00,694 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:00,694 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,695 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:00,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:00,695 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,695 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:00,695 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:00,696 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:00,696 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:00,696 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:00,696 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:00,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:00,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:00,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:00,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:00,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:00,699 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:00,699 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:00,699 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:00,699 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,699 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:00,700 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,700 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,700 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:00,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,701 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,702 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:00,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:00,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:00,703 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:00,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:00,704 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:00,704 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,704 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:00,704 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:00,806 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:00,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:00,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:00,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:00,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,814 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:00,814 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:00,814 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:56:00,814 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:56:00,814 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,814 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,815 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:00,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:00,816 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,816 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:00,816 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:00,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,817 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,830 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:56:00,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:00,830 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:56:00,830 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:00,830 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:56:00,834 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:56:00,834 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:00,834 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:56:00,834 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:00,834 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:01,257 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f6b0a9352bbd4df7bf4f9ad18ca843e1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6b0a9352bbd4df7bf4f9ad18ca843e1 2023-03-20 10:56:01,663 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/051008e497bd453cbe4b29d237d21426 2023-03-20 10:56:01,666 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/051008e497bd453cbe4b29d237d21426 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/051008e497bd453cbe4b29d237d21426 2023-03-20 10:56:01,670 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/051008e497bd453cbe4b29d237d21426, entries=1, sequenceid=21, filesize=4.9 K 2023-03-20 10:56:01,671 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 837ms, sequenceid=21, compaction requested=true 2023-03-20 10:56:01,671 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:01,671 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:01,671 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:01,671 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:01,671 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,671 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:01,671 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:01,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,672 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:01,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,672 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5161a0d0[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:01,673 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:01,673 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,674 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,674 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:01,674 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:01,674 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:01,674 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,674 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:01,675 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:01,675 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:01,675 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,675 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:01,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:01,677 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:01,677 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:01,677 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:01,677 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,677 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:01,678 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:01,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:01,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:01,679 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:01,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,680 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:01,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:01,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:01,681 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:01,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:01,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:01,681 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:01,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:01,782 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:01,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:01,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:01,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:01,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,787 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:01,787 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:01,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:56:01,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:56:01,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,788 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:01,788 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:01,789 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:01,789 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,789 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:56:01,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:01,790 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:56:01,790 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:01,790 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:56:01,790 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:56:01,790 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:01,790 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:01,790 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:56:01,790 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:02,202 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316d07a4889aab42f1a52f6affb400c2d0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512316d07a4889aab42f1a52f6affb400c2d0 2023-03-20 10:56:02,609 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/7cbb443f75e2403a9fa337c68caf836a 2023-03-20 10:56:02,616 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/7cbb443f75e2403a9fa337c68caf836a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/7cbb443f75e2403a9fa337c68caf836a 2023-03-20 10:56:02,621 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/7cbb443f75e2403a9fa337c68caf836a, entries=1, sequenceid=25, filesize=4.9 K 2023-03-20 10:56:02,622 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 832ms, sequenceid=25, compaction requested=true 2023-03-20 10:56:02,622 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:02,622 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:02,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:02,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:02,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:02,622 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:02,624 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,624 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:02,624 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,624 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:02,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:02,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd7027b[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:02,626 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:02,626 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,627 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,627 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:02,627 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:02,628 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:02,628 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,628 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:02,629 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:02,629 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,629 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:02,629 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:02,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:02,632 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:02,632 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:02,632 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:02,632 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,632 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:02,637 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,637 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:02,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,637 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:02,637 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,638 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:02,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:02,646 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:02,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:56:02,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:02,646 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:02,647 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:02,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:02,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:02,747 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:02,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:02,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:02,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:02,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,760 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:02,760 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:02,760 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:56:02,760 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:56:02,761 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,761 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,763 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:02,763 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:02,763 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:02,764 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:56:02,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:56:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:56:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:56:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:02,766 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:02,767 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:56:02,767 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:03,190 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012a818fbc385d4e35b590f5d486505f28 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601012a818fbc385d4e35b590f5d486505f28 2023-03-20 10:56:03,485 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:56:03,597 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/5e80a284cd714eb98ba311b899e1abd2 2023-03-20 10:56:03,601 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/5e80a284cd714eb98ba311b899e1abd2 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/5e80a284cd714eb98ba311b899e1abd2 2023-03-20 10:56:03,604 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/5e80a284cd714eb98ba311b899e1abd2, entries=1, sequenceid=29, filesize=4.9 K 2023-03-20 10:56:03,605 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 838ms, sequenceid=29, compaction requested=true 2023-03-20 10:56:03,605 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:03,605 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:03,605 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:03,605 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:03,605 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,605 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:03,605 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:03,606 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,606 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:03,607 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,607 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:03,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:03,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18c0c8cf[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:03,608 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:03,608 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,609 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,609 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:03,609 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:03,609 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:03,609 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,609 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:03,610 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:03,610 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,610 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:03,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:03,610 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:03,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:03,613 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:03,613 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:03,613 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:03,613 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,613 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:03,614 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,614 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:03,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,615 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:03,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:03,615 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,616 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:03,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:03,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:03,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,618 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:03,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:03,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,619 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:56:03,618 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:03,719 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:03,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:03,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:03,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:03,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,725 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:03,725 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:03,725 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:56:03,725 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:56:03,725 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,725 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,726 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,726 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:03,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:03,726 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:03,726 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,727 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:56:03,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:03,727 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:56:03,727 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:03,727 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:56:03,727 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:56:03,727 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:03,727 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:03,727 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:56:03,727 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:04,141 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103574892eb544c43a28d01855356c7f423 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103574892eb544c43a28d01855356c7f423 2023-03-20 10:56:04,547 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9 2023-03-20 10:56:04,553 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9 2023-03-20 10:56:04,557 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9, entries=1, sequenceid=33, filesize=4.9 K 2023-03-20 10:56:04,558 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 831ms, sequenceid=33, compaction requested=true 2023-03-20 10:56:04,558 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:04,558 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:04,558 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:04,558 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:04,558 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,558 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:04,558 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:04,559 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,559 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:04,559 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,560 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:04,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2879420e[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:04,560 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:04,560 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,561 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,561 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:04,561 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:04,561 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:04,561 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,561 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:04,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:04,563 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:04,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:04,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:04,563 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:04,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:04,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:04,565 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:04,565 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:04,565 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:04,565 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,565 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:04,566 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,566 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,566 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:04,566 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,567 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,568 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,568 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:04,568 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:04,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:04,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:04,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:56:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:04,568 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:04,569 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:04,568 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,568 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:04,569 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,569 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:04,569 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:04,569 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:04,569 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,669 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:04,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:04,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:04,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:04,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,683 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:04,683 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:04,684 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:56:04,684 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:56:04,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,685 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,686 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,686 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:04,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:04,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:04,687 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:04,687 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:04,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:04,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,689 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,690 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:56:04,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:04,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:56:04,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:04,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:56:04,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:56:04,691 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:04,691 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:04,691 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:56:04,691 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:05,107 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078fb66d1664b84a619c91e43844f8cd05 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509078fb66d1664b84a619c91e43844f8cd05 2023-03-20 10:56:05,513 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/2b877824c3e94c0a8ff85c040d9e7c8c 2023-03-20 10:56:05,524 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/2b877824c3e94c0a8ff85c040d9e7c8c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/2b877824c3e94c0a8ff85c040d9e7c8c 2023-03-20 10:56:05,530 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/2b877824c3e94c0a8ff85c040d9e7c8c, entries=1, sequenceid=37, filesize=4.9 K 2023-03-20 10:56:05,531 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 840ms, sequenceid=37, compaction requested=true 2023-03-20 10:56:05,531 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:05,531 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:05,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:05,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:05,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:05,531 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:05,532 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,532 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:05,533 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,533 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:05,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c210f1[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:05,535 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:05,535 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,535 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,536 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:05,536 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:05,536 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:05,536 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,536 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:05,537 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:05,537 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:05,537 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,537 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:05,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:05,540 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:05,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:05,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:05,540 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,540 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:05,541 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,541 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,541 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:05,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:05,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:05,542 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:05,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,544 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,562 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,563 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:05,563 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:05,563 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:05,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:56:05,563 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:05,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:05,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:05,563 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:05,564 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,564 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:05,564 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:05,564 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,565 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:05,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:05,565 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,664 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:05,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:05,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:05,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:05,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,673 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:05,674 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:05,674 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-20 10:56:05,674 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-20 10:56:05,675 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,675 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,676 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:05,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:05,676 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:05,676 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,676 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,677 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-20 10:56:05,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,677 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-20 10:56:05,677 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:05,677 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-20 10:56:05,677 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-20 10:56:05,677 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:05,677 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:05,678 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. started... 2023-03-20 10:56:05,678 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e274008ba03fba13d08e97b9fc403e68 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-20 10:56:05,690 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112099c4023af2494b90a094121a081a962f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112099c4023af2494b90a094121a081a962f 2023-03-20 10:56:05,694 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/9de523cc48534caca340a6b1c16dea58 2023-03-20 10:56:05,698 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/9de523cc48534caca340a6b1c16dea58 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9de523cc48534caca340a6b1c16dea58 2023-03-20 10:56:05,701 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9de523cc48534caca340a6b1c16dea58, entries=1, sequenceid=41, filesize=4.9 K 2023-03-20 10:56:05,702 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e274008ba03fba13d08e97b9fc403e68 in 24ms, sequenceid=41, compaction requested=true 2023-03-20 10:56:05,702 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:05,702 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:05,702 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-20 10:56:05,702 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-20 10:56:05,702 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,702 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-20 10:56:05,702 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-20 10:56:05,703 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,703 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:05,703 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,703 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:05,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-20 10:56:05,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@205200c8[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:05,704 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-20 10:56:05,704 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,705 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,705 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-20 10:56:05,705 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-20 10:56:05,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,705 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:05,705 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:05,705 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-20 10:56:05,706 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,706 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:05,706 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:05,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-20 10:56:05,707 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-20 10:56:05,707 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:05,707 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:05,707 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,707 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:05,708 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,708 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,708 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:05,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:05,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:05,708 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,709 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:05,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,710 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:05,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-20 10:56:05,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:05,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:05,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:05,710 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:05,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-20 10:56:05,711 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:05,711 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,711 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:05,711 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,711 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:05,811 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:05,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:05,813 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-20 10:56:05,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:56:05,815 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:56:05,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:56:05,815 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310365815 2023-03-20 10:56:05,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-20 10:56:05,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-20 10:56:05,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:05,817 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x1f8a6cdf to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:56:05,821 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@80221e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:56:05,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:06,258 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033c1b869c511c44f2bc5539b86212edc4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033c1b869c511c44f2bc5539b86212edc4 2023-03-20 10:56:06,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:06,273 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:56:06,274 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:56:06,280 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:56:06,281 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:56:06,289 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7a5d0418630f41cb98672b4ae20c6f7d first=Optional[r5] last=Optional[r6] 2023-03-20 10:56:06,290 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7a5d0418630f41cb98672b4ae20c6f7d}] 2023-03-20 10:56:06,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7a5d0418630f41cb98672b4ae20c6f7d for inclusion in e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:56:06,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-20 10:56:06,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:56:06,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:06,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7a5d0418630f41cb98672b4ae20c6f7d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kflfsocotq1u247lsp60p4lpa206eh69hrlnifirurlo2uv0v9jmlim0lci5da4a/family1/7a5d0418630f41cb98672b4ae20c6f7d 2023-03-20 10:56:06,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kflfsocotq1u247lsp60p4lpa206eh69hrlnifirurlo2uv0v9jmlim0lci5da4a/family1/7a5d0418630f41cb98672b4ae20c6f7d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_ 2023-03-20 10:56:06,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kflfsocotq1u247lsp60p4lpa206eh69hrlnifirurlo2uv0v9jmlim0lci5da4a/family1/7a5d0418630f41cb98672b4ae20c6f7d into e274008ba03fba13d08e97b9fc403e68/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_ - updating store file list. 2023-03-20 10:56:06,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_ into e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:56:06,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kflfsocotq1u247lsp60p4lpa206eh69hrlnifirurlo2uv0v9jmlim0lci5da4a/family1/7a5d0418630f41cb98672b4ae20c6f7d into e274008ba03fba13d08e97b9fc403e68/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_) 2023-03-20 10:56:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kflfsocotq1u247lsp60p4lpa206eh69hrlnifirurlo2uv0v9jmlim0lci5da4a/family1/7a5d0418630f41cb98672b4ae20c6f7d 2023-03-20 10:56:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-20 10:56:06,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-20 10:56:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(1912): e274008ba03fba13d08e97b9fc403e68/family1 is initiating minor compaction 2023-03-20 10:56:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@76f34fa4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:56:06,311 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e274008ba03fba13d08e97b9fc403e68/family1 in testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:06,311 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/dc3275a80e88430d99757f84001a0d81, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/e0edc449c1b9472e8da214d8433473e3, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/55882e5551f54eb691027dd847794191, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/051008e497bd453cbe4b29d237d21426, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/7cbb443f75e2403a9fa337c68caf836a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/5e80a284cd714eb98ba311b899e1abd2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/2b877824c3e94c0a8ff85c040d9e7c8c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9de523cc48534caca340a6b1c16dea58, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp, totalSize=49.7 K 2023-03-20 10:56:06,311 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting dc3275a80e88430d99757f84001a0d81, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-20 10:56:06,311 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting e0edc449c1b9472e8da214d8433473e3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-20 10:56:06,311 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 55882e5551f54eb691027dd847794191, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-20 10:56:06,311 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 051008e497bd453cbe4b29d237d21426, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-20 10:56:06,312 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 7cbb443f75e2403a9fa337c68caf836a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-20 10:56:06,312 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 5e80a284cd714eb98ba311b899e1abd2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-20 10:56:06,312 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 9ab6c56dd77e45b1bbd3a844a87d2fd9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-20 10:56:06,312 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 2b877824c3e94c0a8ff85c040d9e7c8c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-20 10:56:06,312 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 9de523cc48534caca340a6b1c16dea58, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-20 10:56:06,312 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-20 10:56:06,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:06,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:06,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601012a818fbc385d4e35b590f5d486505f28 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601012a818fbc385d4e35b590f5d486505f28 2023-03-20 10:56:06,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103574892eb544c43a28d01855356c7f423 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103574892eb544c43a28d01855356c7f423 2023-03-20 10:56:06,318 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-20 10:56:06,318 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-20 10:56:06,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:06,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:06,344 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): e274008ba03fba13d08e97b9fc403e68#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:07,174 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/ccb7da1530c44ffa8041cb223692c403 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/ccb7da1530c44ffa8041cb223692c403 2023-03-20 10:56:07,179 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123189917ffa696641099f419e3791eb7c4c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123189917ffa696641099f419e3791eb7c4c 2023-03-20 10:56:07,180 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:07,180 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e274008ba03fba13d08e97b9fc403e68/family1 of e274008ba03fba13d08e97b9fc403e68 into ccb7da1530c44ffa8041cb223692c403(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:56:07,181 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:07,181 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679309766311; duration=0sec 2023-03-20 10:56:07,181 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:56:07,199 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/27e9576fd7a848459715f0026c1ead73 first=Optional[r1] last=Optional[r4] 2023-03-20 10:56:07,200 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/27e9576fd7a848459715f0026c1ead73}] 2023-03-20 10:56:07,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/27e9576fd7a848459715f0026c1ead73 for inclusion in e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:56:07,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-20 10:56:07,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:56:07,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:07,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/27e9576fd7a848459715f0026c1ead73 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a5i3ki8acdj7p38uahd4acm5rkdtf3iupugekq885ro4af5j79kl9tb66nk6jtt/family1/27e9576fd7a848459715f0026c1ead73 2023-03-20 10:56:07,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a5i3ki8acdj7p38uahd4acm5rkdtf3iupugekq885ro4af5j79kl9tb66nk6jtt/family1/27e9576fd7a848459715f0026c1ead73 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_ 2023-03-20 10:56:07,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a5i3ki8acdj7p38uahd4acm5rkdtf3iupugekq885ro4af5j79kl9tb66nk6jtt/family1/27e9576fd7a848459715f0026c1ead73 into e274008ba03fba13d08e97b9fc403e68/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_ - updating store file list. 2023-03-20 10:56:07,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/dc3275a80e88430d99757f84001a0d81, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/e0edc449c1b9472e8da214d8433473e3, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/55882e5551f54eb691027dd847794191, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/051008e497bd453cbe4b29d237d21426, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/7cbb443f75e2403a9fa337c68caf836a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/5e80a284cd714eb98ba311b899e1abd2, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/2b877824c3e94c0a8ff85c040d9e7c8c, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9de523cc48534caca340a6b1c16dea58, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_] to archive 2023-03-20 10:56:07,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:07,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_ into e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:56:07,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a5i3ki8acdj7p38uahd4acm5rkdtf3iupugekq885ro4af5j79kl9tb66nk6jtt/family1/27e9576fd7a848459715f0026c1ead73 into e274008ba03fba13d08e97b9fc403e68/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_) 2023-03-20 10:56:07,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a5i3ki8acdj7p38uahd4acm5rkdtf3iupugekq885ro4af5j79kl9tb66nk6jtt/family1/27e9576fd7a848459715f0026c1ead73 2023-03-20 10:56:07,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/dc3275a80e88430d99757f84001a0d81 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/dc3275a80e88430d99757f84001a0d81 2023-03-20 10:56:07,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-20 10:56:07,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/e0edc449c1b9472e8da214d8433473e3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/e0edc449c1b9472e8da214d8433473e3 2023-03-20 10:56:07,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-20 10:56:07,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(1912): e274008ba03fba13d08e97b9fc403e68/family1 is initiating minor compaction (all files) 2023-03-20 10:56:07,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1bde55b3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:56:07,212 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e274008ba03fba13d08e97b9fc403e68/family1 in testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:07,212 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/8df722be1c694114b9730e43c9a19870, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/ccb7da1530c44ffa8041cb223692c403, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp, totalSize=178.1 K 2023-03-20 10:56:07,212 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 8df722be1c694114b9730e43c9a19870, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878847712 2023-03-20 10:56:07,212 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting ccb7da1530c44ffa8041cb223692c403, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621247712 2023-03-20 10:56:07,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/55882e5551f54eb691027dd847794191 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/55882e5551f54eb691027dd847794191 2023-03-20 10:56:07,212 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] compactions.Compactor(207): Compacting 83bbc05050e641cc9b08c66ce5427978_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965247712 2023-03-20 10:56:07,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:07,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/051008e497bd453cbe4b29d237d21426 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/051008e497bd453cbe4b29d237d21426 2023-03-20 10:56:07,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:07,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/7cbb443f75e2403a9fa337c68caf836a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/7cbb443f75e2403a9fa337c68caf836a 2023-03-20 10:56:07,215 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201a283875888344f06bc83e044cea9f7e4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201a283875888344f06bc83e044cea9f7e4 2023-03-20 10:56:07,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/5e80a284cd714eb98ba311b899e1abd2 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/5e80a284cd714eb98ba311b899e1abd2 2023-03-20 10:56:07,216 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120534b3b2d8ec754c1998108a3137dafdae to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120534b3b2d8ec754c1998108a3137dafdae 2023-03-20 10:56:07,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9ab6c56dd77e45b1bbd3a844a87d2fd9 2023-03-20 10:56:07,217 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6b0a9352bbd4df7bf4f9ad18ca843e1 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6b0a9352bbd4df7bf4f9ad18ca843e1 2023-03-20 10:56:07,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/2b877824c3e94c0a8ff85c040d9e7c8c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/2b877824c3e94c0a8ff85c040d9e7c8c 2023-03-20 10:56:07,218 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512316d07a4889aab42f1a52f6affb400c2d0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512316d07a4889aab42f1a52f6affb400c2d0 2023-03-20 10:56:07,218 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-20 10:56:07,218 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-20 10:56:07,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:07,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9de523cc48534caca340a6b1c16dea58 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/9de523cc48534caca340a6b1c16dea58 2023-03-20 10:56:07,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:07,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/87b5bce04ae84fe9852fbcf06fc6b753_SeqId_44_ 2023-03-20 10:56:07,226 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] throttle.PressureAwareThroughputController(145): e274008ba03fba13d08e97b9fc403e68#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:08,060 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ca79ab2d2eb24f8387b22785740148c4 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ca79ab2d2eb24f8387b22785740148c4 2023-03-20 10:56:08,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:08,085 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ff401748c8724eb5a489bb843306a874 first=Optional[r00] last=Optional[r8] 2023-03-20 10:56:08,085 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ff401748c8724eb5a489bb843306a874}] 2023-03-20 10:56:08,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ff401748c8724eb5a489bb843306a874 for inclusion in e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:56:08,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-20 10:56:08,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last= 2023-03-20 10:56:08,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:08,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ff401748c8724eb5a489bb843306a874 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o74bf5tabriekjt5rboje5q8n6hi7qlpq0p0l5ac7pndu90eeulg9k9fpvovvjr9/family1/ff401748c8724eb5a489bb843306a874 2023-03-20 10:56:08,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o74bf5tabriekjt5rboje5q8n6hi7qlpq0p0l5ac7pndu90eeulg9k9fpvovvjr9/family1/ff401748c8724eb5a489bb843306a874 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/01ddeb25515a498d8a91b22c8a947db3_SeqId_49_ 2023-03-20 10:56:08,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o74bf5tabriekjt5rboje5q8n6hi7qlpq0p0l5ac7pndu90eeulg9k9fpvovvjr9/family1/ff401748c8724eb5a489bb843306a874 into e274008ba03fba13d08e97b9fc403e68/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/01ddeb25515a498d8a91b22c8a947db3_SeqId_49_ - updating store file list. 2023-03-20 10:56:08,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/01ddeb25515a498d8a91b22c8a947db3_SeqId_49_ into e274008ba03fba13d08e97b9fc403e68/family1 2023-03-20 10:56:08,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o74bf5tabriekjt5rboje5q8n6hi7qlpq0p0l5ac7pndu90eeulg9k9fpvovvjr9/family1/ff401748c8724eb5a489bb843306a874 into e274008ba03fba13d08e97b9fc403e68/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/01ddeb25515a498d8a91b22c8a947db3_SeqId_49_) 2023-03-20 10:56:08,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o74bf5tabriekjt5rboje5q8n6hi7qlpq0p0l5ac7pndu90eeulg9k9fpvovvjr9/family1/ff401748c8724eb5a489bb843306a874 2023-03-20 10:56:08,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:08,097 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:08,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112099c4023af2494b90a094121a081a962f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112099c4023af2494b90a094121a081a962f 2023-03-20 10:56:08,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e964dbebddd345668230327496c4f448 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e964dbebddd345668230327496c4f448 2023-03-20 10:56:08,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b4a8c8cefd494e989422959dbc2a36dd to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b4a8c8cefd494e989422959dbc2a36dd 2023-03-20 10:56:08,099 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-20 10:56:08,099 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-20 10:56:08,100 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:08,100 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:08,100 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-20 10:56:08,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-20 10:56:08,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:56:08,102 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-20 10:56:08,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2880 sec 2023-03-20 10:56:08,297 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255 (was 247) - Thread LEAK? -, OpenFileDescriptor=640 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=393 (was 447), ProcessCount=184 (was 192), AvailableMemoryMB=8582 (was 8576) - AvailableMemoryMB LEAK? - 2023-03-20 10:56:08,309 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=255, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=393, ProcessCount=184, AvailableMemoryMB=8581 2023-03-20 10:56:08,329 DEBUG [Listener at localhost.localdomain/43657] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-20 10:56:08,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD1\xFD\x11\xCC\x1E\x1F\x90\xDA\xAF\xD7\xD1\xBC\x8Al\x11\xE7"\x10gQQ{m\x90\xBA\xECv\x1A\x18\xD4\xFF\x8Dl\xE7*\x10\xAFF\x11\xDF\xABC\xF9\xD3j\xE2\x10\x12\x8B\xEA\xD7\xF02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-20 10:56:08,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-20 10:56:08,376 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-20 10:56:08,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-20 10:56:08,377 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-20 10:56:08,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a empty. 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14 empty. 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df empty. 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:08,379 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:08,379 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-20 10:56:08,457 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/.tmp/family1/f16fbb66f694412b87f9fd88779c5883 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/f16fbb66f694412b87f9fd88779c5883 2023-03-20 10:56:08,464 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e274008ba03fba13d08e97b9fc403e68/family1 of e274008ba03fba13d08e97b9fc403e68 into f16fbb66f694412b87f9fd88779c5883(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:56:08,465 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:08,465 INFO [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1679309767211; duration=1sec 2023-03-20 10:56:08,465 DEBUG [RS:0;jenkins-hbase20:44189-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-20 10:56:08,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-20 10:56:08,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/8df722be1c694114b9730e43c9a19870, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/ccb7da1530c44ffa8041cb223692c403, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_] to archive 2023-03-20 10:56:08,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:08,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/8df722be1c694114b9730e43c9a19870 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/8df722be1c694114b9730e43c9a19870 2023-03-20 10:56:08,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/ccb7da1530c44ffa8041cb223692c403 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/ccb7da1530c44ffa8041cb223692c403 2023-03-20 10:56:08,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_ to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/family1/83bbc05050e641cc9b08c66ce5427978_SeqId_47_ 2023-03-20 10:56:08,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-20 10:56:08,788 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-20 10:56:08,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 37397f8d9cd9e81f41b688f4ba4a02df, NAME => 'testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD1\xFD\x11\xCC\x1E\x1F\x90\xDA\xAF\xD7\xD1\xBC\x8Al\x11\xE7"\x10gQQ{m\x90\xBA\xECv\x1A\x18\xD4\xFF\x8Dl\xE7*\x10\xAFF\x11\xDF\xABC\xF9\xD3j\xE2\x10\x12\x8B\xEA\xD7\xF02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:56:08,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3f7abb66b37c7d8d5eae5e6ae9446c14, NAME => 'testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD1\xFD\x11\xCC\x1E\x1F\x90\xDA\xAF\xD7\xD1\xBC\x8Al\x11\xE7"\x10gQQ{m\x90\xBA\xECv\x1A\x18\xD4\xFF\x8Dl\xE7*\x10\xAFF\x11\xDF\xABC\xF9\xD3j\xE2\x10\x12\x8B\xEA\xD7\xF02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:56:08,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => c42ba4a29d72a9f860b2395947daeb4a, NAME => 'testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD1\xFD\x11\xCC\x1E\x1F\x90\xDA\xAF\xD7\xD1\xBC\x8Al\x11\xE7"\x10gQQ{m\x90\xBA\xECv\x1A\x18\xD4\xFF\x8Dl\xE7*\x10\xAFF\x11\xDF\xABC\xF9\xD3j\xE2\x10\x12\x8B\xEA\xD7\xF02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/.tmp 2023-03-20 10:56:08,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:56:08,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing c42ba4a29d72a9f860b2395947daeb4a, disabling compactions & flushes 2023-03-20 10:56:08,802 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:08,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:08,803 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. after waiting 0 ms 2023-03-20 10:56:08,803 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:08,803 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:08,803 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:08,806 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:56:08,806 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 3f7abb66b37c7d8d5eae5e6ae9446c14, disabling compactions & flushes 2023-03-20 10:56:08,806 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:08,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:08,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. after waiting 0 ms 2023-03-20 10:56:08,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:08,807 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:08,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:08,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-20 10:56:09,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:56:09,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 37397f8d9cd9e81f41b688f4ba4a02df, disabling compactions & flushes 2023-03-20 10:56:09,211 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. after waiting 0 ms 2023-03-20 10:56:09,212 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,212 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,212 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:09,214 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-20 10:56:09,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309769215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309769215"}]},"ts":"1679309769215"} 2023-03-20 10:56:09,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309769215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309769215"}]},"ts":"1679309769215"} 2023-03-20 10:56:09,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679309769215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679309769215"}]},"ts":"1679309769215"} 2023-03-20 10:56:09,217 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-20 10:56:09,218 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-20 10:56:09,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309769218"}]},"ts":"1679309769218"} 2023-03-20 10:56:09,220 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-20 10:56:09,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c42ba4a29d72a9f860b2395947daeb4a, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=37397f8d9cd9e81f41b688f4ba4a02df, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3f7abb66b37c7d8d5eae5e6ae9446c14, ASSIGN}] 2023-03-20 10:56:09,224 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c42ba4a29d72a9f860b2395947daeb4a, ASSIGN 2023-03-20 10:56:09,224 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3f7abb66b37c7d8d5eae5e6ae9446c14, ASSIGN 2023-03-20 10:56:09,224 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=37397f8d9cd9e81f41b688f4ba4a02df, ASSIGN 2023-03-20 10:56:09,225 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c42ba4a29d72a9f860b2395947daeb4a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:56:09,226 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3f7abb66b37c7d8d5eae5e6ae9446c14, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:56:09,226 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=37397f8d9cd9e81f41b688f4ba4a02df, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44189,1679309623230; forceNewPlan=false, retain=false 2023-03-20 10:56:09,378 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=37397f8d9cd9e81f41b688f4ba4a02df, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:09,378 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3f7abb66b37c7d8d5eae5e6ae9446c14, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:09,378 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679309769378"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309769378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309769378"}]},"ts":"1679309769378"} 2023-03-20 10:56:09,378 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309769378"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309769378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309769378"}]},"ts":"1679309769378"} 2023-03-20 10:56:09,378 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=c42ba4a29d72a9f860b2395947daeb4a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:09,378 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309769378"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679309769378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679309769378"}]},"ts":"1679309769378"} 2023-03-20 10:56:09,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 3f7abb66b37c7d8d5eae5e6ae9446c14, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:56:09,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 37397f8d9cd9e81f41b688f4ba4a02df, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:56:09,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure c42ba4a29d72a9f860b2395947daeb4a, server=jenkins-hbase20.apache.org,44189,1679309623230}] 2023-03-20 10:56:09,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-20 10:56:09,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:09,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f7abb66b37c7d8d5eae5e6ae9446c14, NAME => 'testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.', STARTKEY => '2', ENDKEY => ''} 2023-03-20 10:56:09,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:56:09,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,571 INFO [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,573 DEBUG [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1 2023-03-20 10:56:09,573 DEBUG [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1 2023-03-20 10:56:09,574 INFO [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f7abb66b37c7d8d5eae5e6ae9446c14 columnFamilyName family1 2023-03-20 10:56:09,575 INFO [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] regionserver.HStore(310): Store=3f7abb66b37c7d8d5eae5e6ae9446c14/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:56:09,575 INFO [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,576 DEBUG [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2 2023-03-20 10:56:09,576 DEBUG [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2 2023-03-20 10:56:09,577 INFO [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f7abb66b37c7d8d5eae5e6ae9446c14 columnFamilyName family2 2023-03-20 10:56:09,578 INFO [StoreOpener-3f7abb66b37c7d8d5eae5e6ae9446c14-1] regionserver.HStore(310): Store=3f7abb66b37c7d8d5eae5e6ae9446c14/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:56:09,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:56:09,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:09,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:56:09,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3f7abb66b37c7d8d5eae5e6ae9446c14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64421338, jitterRate=-0.040047258138656616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:56:09,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:09,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14., pid=120, masterSystemTime=1679309769537 2023-03-20 10:56:09,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:09,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:09,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:09,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c42ba4a29d72a9f860b2395947daeb4a, NAME => 'testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.', STARTKEY => '', ENDKEY => '1'} 2023-03-20 10:56:09,586 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3f7abb66b37c7d8d5eae5e6ae9446c14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:09,586 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309769586"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309769586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309769586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309769586"}]},"ts":"1679309769586"} 2023-03-20 10:56:09,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:56:09,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-03-20 10:56:09,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 3f7abb66b37c7d8d5eae5e6ae9446c14, server=jenkins-hbase20.apache.org,44189,1679309623230 in 203 msec 2023-03-20 10:56:09,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3f7abb66b37c7d8d5eae5e6ae9446c14, ASSIGN in 367 msec 2023-03-20 10:56:09,605 INFO [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,607 DEBUG [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1 2023-03-20 10:56:09,607 DEBUG [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1 2023-03-20 10:56:09,607 INFO [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c42ba4a29d72a9f860b2395947daeb4a columnFamilyName family1 2023-03-20 10:56:09,608 INFO [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] regionserver.HStore(310): Store=c42ba4a29d72a9f860b2395947daeb4a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:56:09,608 INFO [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,609 DEBUG [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2 2023-03-20 10:56:09,609 DEBUG [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2 2023-03-20 10:56:09,609 INFO [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c42ba4a29d72a9f860b2395947daeb4a columnFamilyName family2 2023-03-20 10:56:09,610 INFO [StoreOpener-c42ba4a29d72a9f860b2395947daeb4a-1] regionserver.HStore(310): Store=c42ba4a29d72a9f860b2395947daeb4a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:56:09,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:56:09,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:09,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:56:09,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c42ba4a29d72a9f860b2395947daeb4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73146305, jitterRate=0.08996488153934479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:56:09,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:09,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a., pid=122, masterSystemTime=1679309769537 2023-03-20 10:56:09,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:09,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:09,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37397f8d9cd9e81f41b688f4ba4a02df, NAME => 'testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.', STARTKEY => '1', ENDKEY => '2'} 2023-03-20 10:56:09,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=c42ba4a29d72a9f860b2395947daeb4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:09,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-20 10:56:09,616 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679309769616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309769616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309769616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309769616"}]},"ts":"1679309769616"} 2023-03-20 10:56:09,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-03-20 10:56:09,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure c42ba4a29d72a9f860b2395947daeb4a, server=jenkins-hbase20.apache.org,44189,1679309623230 in 233 msec 2023-03-20 10:56:09,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c42ba4a29d72a9f860b2395947daeb4a, ASSIGN in 397 msec 2023-03-20 10:56:09,643 INFO [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,645 DEBUG [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1 2023-03-20 10:56:09,645 DEBUG [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1 2023-03-20 10:56:09,645 INFO [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37397f8d9cd9e81f41b688f4ba4a02df columnFamilyName family1 2023-03-20 10:56:09,646 INFO [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] regionserver.HStore(310): Store=37397f8d9cd9e81f41b688f4ba4a02df/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:56:09,646 INFO [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,647 DEBUG [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2 2023-03-20 10:56:09,647 DEBUG [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2 2023-03-20 10:56:09,647 INFO [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37397f8d9cd9e81f41b688f4ba4a02df columnFamilyName family2 2023-03-20 10:56:09,648 INFO [StoreOpener-37397f8d9cd9e81f41b688f4ba4a02df-1] regionserver.HStore(310): Store=37397f8d9cd9e81f41b688f4ba4a02df/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-20 10:56:09,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-20 10:56:09,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:09,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-20 10:56:09,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 37397f8d9cd9e81f41b688f4ba4a02df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68038932, jitterRate=0.013859093189239502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-20 10:56:09,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:09,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df., pid=121, masterSystemTime=1679309769537 2023-03-20 10:56:09,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:09,654 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=37397f8d9cd9e81f41b688f4ba4a02df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:09,654 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679309769654"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679309769654"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679309769654"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679309769654"}]},"ts":"1679309769654"} 2023-03-20 10:56:09,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-03-20 10:56:09,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 37397f8d9cd9e81f41b688f4ba4a02df, server=jenkins-hbase20.apache.org,44189,1679309623230 in 272 msec 2023-03-20 10:56:09,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-20 10:56:09,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=37397f8d9cd9e81f41b688f4ba4a02df, ASSIGN in 435 msec 2023-03-20 10:56:09,663 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-20 10:56:09,663 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679309769663"}]},"ts":"1679309769663"} 2023-03-20 10:56:09,664 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-20 10:56:09,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-20 10:56:09,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2950 sec 2023-03-20 10:56:10,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-20 10:56:10,484 INFO [Listener at localhost.localdomain/43657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-20 10:56:10,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:10,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:10,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:10,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:10,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-20 10:56:10,514 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-20 10:56:10,514 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:10,514 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-20 10:56:10,514 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-20 10:56:10,515 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:10,515 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:10,515 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:10,515 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:10,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:10,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:10,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:10,516 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:10,516 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:10,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:10,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:10,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:10,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-20 10:56:10,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-20 10:56:10,522 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-20 10:56:10,522 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:10,522 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-20 10:56:10,530 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:10,530 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. started... 2023-03-20 10:56:10,542 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:10,543 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. started... 2023-03-20 10:56:10,543 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:56:10,554 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c42ba4a29d72a9f860b2395947daeb4a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:56:10,554 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:10,558 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37397f8d9cd9e81f41b688f4ba4a02df 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:56:10,551 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:10,559 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. started... 2023-03-20 10:56:10,560 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3f7abb66b37c7d8d5eae5e6ae9446c14 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-20 10:56:10,670 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320d6c8529641974bb7af2423408c371e7c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320d6c8529641974bb7af2423408c371e7c 2023-03-20 10:56:10,683 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032015d57f02c6744b9fbff3812a1b553c1f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023032015d57f02c6744b9fbff3812a1b553c1f 2023-03-20 10:56:10,695 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032059427cee947d4618b5451929ced414d8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032059427cee947d4618b5451929ced414d8 2023-03-20 10:56:11,113 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/1f76984f7dd740689c78e887fc860978 2023-03-20 10:56:11,123 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/2e978dc1715c4e368875695beb46f4ba 2023-03-20 10:56:11,123 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/9185e8d0156446808f1886ab5aeeaa81 2023-03-20 10:56:11,583 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320515d7dcef689492bb1c29725234756ff to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230320515d7dcef689492bb1c29725234756ff 2023-03-20 10:56:11,602 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303208de1984a48c64f4db71a0be2568e8f3b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303208de1984a48c64f4db71a0be2568e8f3b 2023-03-20 10:56:11,613 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320853f818c1d794649be1f3444d1a3d65d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230320853f818c1d794649be1f3444d1a3d65d 2023-03-20 10:56:11,618 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/b8756aa76ac145fb850ceeded48be080 2023-03-20 10:56:11,627 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/9185e8d0156446808f1886ab5aeeaa81 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/9185e8d0156446808f1886ab5aeeaa81 2023-03-20 10:56:11,653 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/3d86619fd0bb4cae98dfdeb77d093ef8 2023-03-20 10:56:11,662 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/2e978dc1715c4e368875695beb46f4ba as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/2e978dc1715c4e368875695beb46f4ba 2023-03-20 10:56:11,670 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/9185e8d0156446808f1886ab5aeeaa81, entries=4, sequenceid=5, filesize=5.5 K 2023-03-20 10:56:11,674 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/b8756aa76ac145fb850ceeded48be080 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/b8756aa76ac145fb850ceeded48be080 2023-03-20 10:56:11,690 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/b8756aa76ac145fb850ceeded48be080, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:56:11,691 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3f7abb66b37c7d8d5eae5e6ae9446c14 in 1131ms, sequenceid=5, compaction requested=false 2023-03-20 10:56:11,692 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-20 10:56:11,692 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:11,692 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:11,692 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:56:11,705 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/2e978dc1715c4e368875695beb46f4ba, entries=4, sequenceid=5, filesize=5.5 K 2023-03-20 10:56:11,706 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/3d86619fd0bb4cae98dfdeb77d093ef8 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/3d86619fd0bb4cae98dfdeb77d093ef8 2023-03-20 10:56:11,712 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/3d86619fd0bb4cae98dfdeb77d093ef8, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:56:11,713 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c42ba4a29d72a9f860b2395947daeb4a in 1159ms, sequenceid=5, compaction requested=false 2023-03-20 10:56:11,714 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:11,715 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:11,715 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:56:12,011 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/ca8d6ac90b074aea974f9f1f513cee8f 2023-03-20 10:56:12,016 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/1f76984f7dd740689c78e887fc860978 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/1f76984f7dd740689c78e887fc860978 2023-03-20 10:56:12,052 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/1f76984f7dd740689c78e887fc860978, entries=4, sequenceid=5, filesize=5.5 K 2023-03-20 10:56:12,053 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/ca8d6ac90b074aea974f9f1f513cee8f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/ca8d6ac90b074aea974f9f1f513cee8f 2023-03-20 10:56:12,061 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/ca8d6ac90b074aea974f9f1f513cee8f, entries=2, sequenceid=5, filesize=5.1 K 2023-03-20 10:56:12,064 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 37397f8d9cd9e81f41b688f4ba4a02df in 1506ms, sequenceid=5, compaction requested=false 2023-03-20 10:56:12,064 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:12,064 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:12,064 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:56:12,064 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:56:12,064 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,064 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-20 10:56:12,064 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-20 10:56:12,066 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,066 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:12,066 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,066 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:12,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-20 10:56:12,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e4a32bd[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:12,067 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-20 10:56:12,068 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,068 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,068 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-20 10:56:12,069 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-20 10:56:12,069 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:12,069 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,069 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:12,070 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,070 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-20 10:56:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:12,070 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:12,070 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-20 10:56:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-20 10:56:12,076 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-20 10:56:12,076 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:12,076 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:12,077 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-20 10:56:12,077 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:12,087 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,087 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,087 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:12,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:12,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:12,088 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:12,089 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:12,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:12,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:12,095 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,098 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:12,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:12,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-20 10:56:12,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:12,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:12,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-20 10:56:12,099 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:12,099 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:12,199 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:12,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:12,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:12,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:12,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:12,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:12,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:12,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-20 10:56:12,208 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-20 10:56:12,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:12,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-20 10:56:12,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-20 10:56:12,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,208 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:12,209 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:12,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:12,210 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:12,215 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:12,215 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:12,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:12,215 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-20 10:56:12,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-20 10:56:12,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-20 10:56:12,219 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-20 10:56:12,219 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:12,219 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-20 10:56:12,222 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:12,222 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. started... 2023-03-20 10:56:12,223 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c42ba4a29d72a9f860b2395947daeb4a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:56:12,224 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:12,224 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. started... 2023-03-20 10:56:12,224 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37397f8d9cd9e81f41b688f4ba4a02df 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:56:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:56:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:12,225 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:12,225 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. started... 2023-03-20 10:56:12,225 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3f7abb66b37c7d8d5eae5e6ae9446c14 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-20 10:56:12,292 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320c5f4f06088744728927394e6c986fb34 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320c5f4f06088744728927394e6c986fb34 2023-03-20 10:56:12,713 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320b251b667b74c470c8267fbbb18129e22 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320b251b667b74c470c8267fbbb18129e22 2023-03-20 10:56:12,714 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/7051ddf3abb344f3a2f56a09dffd8d26 2023-03-20 10:56:12,741 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320fcf4b7a04dbb429aa09e911313ccdae3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320fcf4b7a04dbb429aa09e911313ccdae3 2023-03-20 10:56:12,747 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/68bb00be771c4a21bd74428301f5c775 2023-03-20 10:56:12,776 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320e96f212a9d9b47f79f5bb9b382e72df7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230320e96f212a9d9b47f79f5bb9b382e72df7 2023-03-20 10:56:12,819 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320750e47c944e54d80aad590dff67e125c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230320750e47c944e54d80aad590dff67e125c 2023-03-20 10:56:12,826 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/7db5b198ce364c55a9448b93a7eea771 2023-03-20 10:56:12,831 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/68bb00be771c4a21bd74428301f5c775 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/68bb00be771c4a21bd74428301f5c775 2023-03-20 10:56:12,863 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/68bb00be771c4a21bd74428301f5c775, entries=4, sequenceid=9, filesize=5.5 K 2023-03-20 10:56:12,864 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/7db5b198ce364c55a9448b93a7eea771 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/7db5b198ce364c55a9448b93a7eea771 2023-03-20 10:56:12,869 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/7db5b198ce364c55a9448b93a7eea771, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:56:12,870 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3f7abb66b37c7d8d5eae5e6ae9446c14 in 645ms, sequenceid=9, compaction requested=false 2023-03-20 10:56:12,870 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:12,870 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:12,874 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:56:13,164 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/f9e8ce58f511412f9b32f86d6f019c4d 2023-03-20 10:56:13,213 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/0cf3ac47b5a14a7dbad98cf4df706464 2023-03-20 10:56:13,217 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/7051ddf3abb344f3a2f56a09dffd8d26 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/7051ddf3abb344f3a2f56a09dffd8d26 2023-03-20 10:56:13,247 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/7051ddf3abb344f3a2f56a09dffd8d26, entries=4, sequenceid=9, filesize=5.5 K 2023-03-20 10:56:13,248 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/0cf3ac47b5a14a7dbad98cf4df706464 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/0cf3ac47b5a14a7dbad98cf4df706464 2023-03-20 10:56:13,252 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/0cf3ac47b5a14a7dbad98cf4df706464, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:56:13,253 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c42ba4a29d72a9f860b2395947daeb4a in 1030ms, sequenceid=9, compaction requested=false 2023-03-20 10:56:13,253 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:13,253 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:13,253 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:56:13,626 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320b8ea1a6d42bd4eb68c6eb50df56f50b6 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230320b8ea1a6d42bd4eb68c6eb50df56f50b6 2023-03-20 10:56:13,643 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/37acf7a516bd48beac04d28791e3252f 2023-03-20 10:56:13,648 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/f9e8ce58f511412f9b32f86d6f019c4d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/f9e8ce58f511412f9b32f86d6f019c4d 2023-03-20 10:56:13,681 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/f9e8ce58f511412f9b32f86d6f019c4d, entries=4, sequenceid=9, filesize=5.5 K 2023-03-20 10:56:13,681 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/37acf7a516bd48beac04d28791e3252f as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/37acf7a516bd48beac04d28791e3252f 2023-03-20 10:56:13,689 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/37acf7a516bd48beac04d28791e3252f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-20 10:56:13,689 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 37397f8d9cd9e81f41b688f4ba4a02df in 1465ms, sequenceid=9, compaction requested=false 2023-03-20 10:56:13,690 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:13,690 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:56:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:56:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-20 10:56:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-20 10:56:13,691 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,691 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,692 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:13,694 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:13,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-20 10:56:13,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c417e48[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:13,698 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-20 10:56:13,698 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,712 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,712 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-20 10:56:13,712 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-20 10:56:13,712 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:13,712 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,712 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:13,720 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-20 10:56:13,720 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,720 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:13,721 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-20 10:56:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:13,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-20 10:56:13,724 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-20 10:56:13,724 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:13,724 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:13,724 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-20 10:56:13,724 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:13,729 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,729 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:13,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,729 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,729 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:13,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:13,731 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:13,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:13,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-20 10:56:13,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:13,737 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:13,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:13,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-20 10:56:13,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:13,738 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:13,838 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:13,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:13,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:13,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:13,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:13,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:13,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:13,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-20 10:56:13,866 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-20 10:56:13,866 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:13,866 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-20 10:56:13,866 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-20 10:56:13,868 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,868 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:13,873 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:13,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:13,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:13,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:13,874 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:13,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:13,874 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-20 10:56:13,875 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-20 10:56:13,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-20 10:56:13,875 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-20 10:56:13,875 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:13,875 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-20 10:56:13,875 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:13,875 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:13,875 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:13,875 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. started... 2023-03-20 10:56:13,876 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c42ba4a29d72a9f860b2395947daeb4a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:56:13,876 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:13,876 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. started... 2023-03-20 10:56:13,877 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37397f8d9cd9e81f41b688f4ba4a02df 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:56:13,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:56:13,877 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:13,877 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:13,877 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. started... 2023-03-20 10:56:13,877 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3f7abb66b37c7d8d5eae5e6ae9446c14 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-20 10:56:13,952 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320cadbfc9e1eb043fdbd8277aac5df8305 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320cadbfc9e1eb043fdbd8277aac5df8305 2023-03-20 10:56:13,982 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/705d4a34af5e4eb7bd1dc7319a3de862 2023-03-20 10:56:14,359 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032058fcf50a1d1a44939c19ea49edf3c454 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032058fcf50a1d1a44939c19ea49edf3c454 2023-03-20 10:56:14,384 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320988403ce05a64256b0a9415c0497a5d7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320988403ce05a64256b0a9415c0497a5d7 2023-03-20 10:56:14,403 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8 2023-03-20 10:56:14,437 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/2b6e9dce958648cbbdb172d6e9a4481d 2023-03-20 10:56:14,439 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320bb505208fb7e491292912884faca452c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230320bb505208fb7e491292912884faca452c 2023-03-20 10:56:14,493 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/592516ec30b04b33b93d6d7ef6663c21 2023-03-20 10:56:14,496 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320f8729bf3279345ecadfda74e1eeb27e8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230320f8729bf3279345ecadfda74e1eeb27e8 2023-03-20 10:56:14,499 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/705d4a34af5e4eb7bd1dc7319a3de862 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/705d4a34af5e4eb7bd1dc7319a3de862 2023-03-20 10:56:14,526 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320a3a66c0208a546268826601689e0741e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230320a3a66c0208a546268826601689e0741e 2023-03-20 10:56:14,532 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/3ca91c8e560f4cc8a9aa4276b8525bb0 2023-03-20 10:56:14,535 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/705d4a34af5e4eb7bd1dc7319a3de862, entries=4, sequenceid=13, filesize=5.5 K 2023-03-20 10:56:14,538 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8 2023-03-20 10:56:14,538 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/592516ec30b04b33b93d6d7ef6663c21 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/592516ec30b04b33b93d6d7ef6663c21 2023-03-20 10:56:14,559 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/9b740885fa50462c8fae04a51103fccf 2023-03-20 10:56:14,571 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/2b6e9dce958648cbbdb172d6e9a4481d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/2b6e9dce958648cbbdb172d6e9a4481d 2023-03-20 10:56:14,571 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/592516ec30b04b33b93d6d7ef6663c21, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:56:14,572 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c42ba4a29d72a9f860b2395947daeb4a in 696ms, sequenceid=13, compaction requested=true 2023-03-20 10:56:14,573 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:14,573 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:14,573 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:56:14,580 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8, entries=4, sequenceid=13, filesize=5.5 K 2023-03-20 10:56:14,581 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/3ca91c8e560f4cc8a9aa4276b8525bb0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/3ca91c8e560f4cc8a9aa4276b8525bb0 2023-03-20 10:56:14,586 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/3ca91c8e560f4cc8a9aa4276b8525bb0, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:56:14,587 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3f7abb66b37c7d8d5eae5e6ae9446c14 in 710ms, sequenceid=13, compaction requested=true 2023-03-20 10:56:14,587 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:14,587 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:14,592 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:56:14,699 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:56:14,699 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ce88277 to 127.0.0.1:62837 2023-03-20 10:56:14,699 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:14,700 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:56:14,700 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f8a6cdf to 127.0.0.1:62837 2023-03-20 10:56:14,700 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:14,716 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/2b6e9dce958648cbbdb172d6e9a4481d, entries=4, sequenceid=13, filesize=5.5 K 2023-03-20 10:56:14,717 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/9b740885fa50462c8fae04a51103fccf as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/9b740885fa50462c8fae04a51103fccf 2023-03-20 10:56:14,724 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/9b740885fa50462c8fae04a51103fccf, entries=2, sequenceid=13, filesize=5.1 K 2023-03-20 10:56:14,725 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 37397f8d9cd9e81f41b688f4ba4a02df in 848ms, sequenceid=13, compaction requested=true 2023-03-20 10:56:14,725 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:14,725 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:14,725 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:56:14,725 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:56:14,725 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,725 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-20 10:56:14,725 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-20 10:56:14,733 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,733 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:14,734 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,734 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:14,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-20 10:56:14,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3860b8a9[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:14,740 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-20 10:56:14,740 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,745 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,746 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-20 10:56:14,746 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:14,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-20 10:56:14,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:14,747 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-20 10:56:14,747 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:14,747 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-20 10:56:14,747 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:14,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-20 10:56:14,749 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-20 10:56:14,749 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:14,749 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:14,749 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-20 10:56:14,749 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:14,762 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,762 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,762 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:14,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:14,762 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:14,764 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:14,772 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:14,772 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:14,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:14,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-20 10:56:14,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:14,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-20 10:56:14,773 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:14,773 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:14,873 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:14,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:14,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:14,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:14,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44189] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. with WAL disabled. Data may be lost in the event of a crash. 2023-03-20 10:56:14,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:14,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:14,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-20 10:56:14,886 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-20 10:56:14,886 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:14,886 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-20 10:56:14,886 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-20 10:56:14,887 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,887 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:14,888 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:14,888 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:14,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:14,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:14,888 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:14,888 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:14,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:14,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:14,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:14,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-20 10:56:14,889 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-20 10:56:14,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-20 10:56:14,889 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-20 10:56:14,889 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:14,889 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-20 10:56:14,890 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:14,890 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. started... 2023-03-20 10:56:14,890 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:14,890 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. started... 2023-03-20 10:56:14,890 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c42ba4a29d72a9f860b2395947daeb4a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:56:14,890 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37397f8d9cd9e81f41b688f4ba4a02df 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:56:14,890 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:56:14,890 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:14,891 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:14,891 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. started... 2023-03-20 10:56:14,891 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3f7abb66b37c7d8d5eae5e6ae9446c14 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-20 10:56:15,035 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303201cbac59660054419810d1c41277b3776 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303201cbac59660054419810d1c41277b3776 2023-03-20 10:56:15,045 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320e10557ae5e8c449c901938872afc0aa0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320e10557ae5e8c449c901938872afc0aa0 2023-03-20 10:56:15,087 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/b2d4d9ee306d45beab116969d839973a 2023-03-20 10:56:15,091 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/e1209e161eec407fb3fa923c0e4cdc8b 2023-03-20 10:56:15,136 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032033a84a68ec4a43dfa1372d1531531d16 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023032033a84a68ec4a43dfa1372d1531531d16 2023-03-20 10:56:15,156 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320848f62f69306498293e6f17189b74e77 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230320848f62f69306498293e6f17189b74e77 2023-03-20 10:56:15,215 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-20 10:56:15,421 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320854a8ffa37e947809e223e566c9ff6af to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320854a8ffa37e947809e223e566c9ff6af 2023-03-20 10:56:15,553 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/684d359c029447c5881da62c563d31cd 2023-03-20 10:56:15,560 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/e1209e161eec407fb3fa923c0e4cdc8b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/e1209e161eec407fb3fa923c0e4cdc8b 2023-03-20 10:56:15,565 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/460000288c844fecabc98458d6dc9e20 2023-03-20 10:56:15,570 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/b2d4d9ee306d45beab116969d839973a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/b2d4d9ee306d45beab116969d839973a 2023-03-20 10:56:15,584 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/e1209e161eec407fb3fa923c0e4cdc8b, entries=4, sequenceid=17, filesize=5.5 K 2023-03-20 10:56:15,585 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/684d359c029447c5881da62c563d31cd as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/684d359c029447c5881da62c563d31cd 2023-03-20 10:56:15,588 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/684d359c029447c5881da62c563d31cd, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:56:15,589 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 37397f8d9cd9e81f41b688f4ba4a02df in 699ms, sequenceid=17, compaction requested=true 2023-03-20 10:56:15,589 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:15,589 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:15,589 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:56:15,593 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/b2d4d9ee306d45beab116969d839973a, entries=4, sequenceid=17, filesize=5.5 K 2023-03-20 10:56:15,594 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/460000288c844fecabc98458d6dc9e20 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/460000288c844fecabc98458d6dc9e20 2023-03-20 10:56:15,597 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/460000288c844fecabc98458d6dc9e20, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:56:15,598 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c42ba4a29d72a9f860b2395947daeb4a in 708ms, sequenceid=17, compaction requested=true 2023-03-20 10:56:15,598 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:15,598 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:15,598 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:56:15,834 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/08a33462f73c4d5fb5086a636e5cc11e 2023-03-20 10:56:16,272 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032098e995168f1044c3899c617a03ed1a02 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023032098e995168f1044c3899c617a03ed1a02 2023-03-20 10:56:16,681 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/c5b77fe15cf14073ae483199a9d3dfa7 2023-03-20 10:56:16,685 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/08a33462f73c4d5fb5086a636e5cc11e as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/08a33462f73c4d5fb5086a636e5cc11e 2023-03-20 10:56:16,707 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/08a33462f73c4d5fb5086a636e5cc11e, entries=4, sequenceid=17, filesize=5.5 K 2023-03-20 10:56:16,715 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/c5b77fe15cf14073ae483199a9d3dfa7 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c5b77fe15cf14073ae483199a9d3dfa7 2023-03-20 10:56:16,719 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c5b77fe15cf14073ae483199a9d3dfa7, entries=2, sequenceid=17, filesize=5.1 K 2023-03-20 10:56:16,720 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3f7abb66b37c7d8d5eae5e6ae9446c14 in 1829ms, sequenceid=17, compaction requested=true 2023-03-20 10:56:16,720 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:16,720 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:16,722 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:56:16,722 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:56:16,722 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,722 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-20 10:56:16,722 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-20 10:56:16,728 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,728 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:16,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:16,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:16,728 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,728 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:16,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:16,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:16,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:16,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-20 10:56:16,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@884bb2d[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:16,729 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-20 10:56:16,729 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,730 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,730 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-20 10:56:16,730 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,730 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:16,730 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-20 10:56:16,730 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:16,731 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-20 10:56:16,731 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,731 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:16,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:16,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:16,731 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-20 10:56:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:16,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:16,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-20 10:56:16,733 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-20 10:56:16,733 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:16,733 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:16,733 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-20 10:56:16,733 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:16,734 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,734 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:16,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,734 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:16,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:16,735 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:16,736 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:16,737 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:16,737 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-20 10:56:16,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:16,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:16,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:16,738 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,738 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:16,738 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:16,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:16,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:16,838 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:16,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:16,848 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:56:16,858 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:56:16,868 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:56:16,869 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:56:16,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-20 10:56:16,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-20 10:56:16,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-20 10:56:16,976 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-20 10:56:16,977 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:16,977 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-20 10:56:16,977 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-20 10:56:16,977 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,977 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:16,978 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,978 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:16,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:16,978 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:16,978 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-20 10:56:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:16,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-20 10:56:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:16,979 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-20 10:56:16,982 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-20 10:56:16,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-20 10:56:16,982 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-20 10:56:16,982 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-20 10:56:16,982 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-20 10:56:16,986 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:16,986 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. started... 2023-03-20 10:56:16,986 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c42ba4a29d72a9f860b2395947daeb4a 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:56:16,990 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:16,990 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. started... 2023-03-20 10:56:16,990 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37397f8d9cd9e81f41b688f4ba4a02df 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:56:16,994 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-20 10:56:16,994 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-20 10:56:16,994 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:16,994 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. started... 2023-03-20 10:56:16,994 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3f7abb66b37c7d8d5eae5e6ae9446c14 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-20 10:56:17,442 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/525900de037c4ca99561dd2a06524d32 2023-03-20 10:56:17,461 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 525900de037c4ca99561dd2a06524d32 2023-03-20 10:56:17,843 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/dbc9a19b3759416db81816c9a5385c4b 2023-03-20 10:56:17,847 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/5164e5bb2a544bcaab845c2e652539ac 2023-03-20 10:56:17,882 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbc9a19b3759416db81816c9a5385c4b 2023-03-20 10:56:17,882 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5164e5bb2a544bcaab845c2e652539ac 2023-03-20 10:56:18,271 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/9f942fcb153b4e5b8fb5995ecc92863d 2023-03-20 10:56:18,275 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f942fcb153b4e5b8fb5995ecc92863d 2023-03-20 10:56:18,275 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/525900de037c4ca99561dd2a06524d32 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/525900de037c4ca99561dd2a06524d32 2023-03-20 10:56:18,302 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 525900de037c4ca99561dd2a06524d32 2023-03-20 10:56:18,302 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/525900de037c4ca99561dd2a06524d32, entries=3, sequenceid=23, filesize=5.2 K 2023-03-20 10:56:18,303 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/9f942fcb153b4e5b8fb5995ecc92863d as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/9f942fcb153b4e5b8fb5995ecc92863d 2023-03-20 10:56:18,307 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f942fcb153b4e5b8fb5995ecc92863d 2023-03-20 10:56:18,307 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/9f942fcb153b4e5b8fb5995ecc92863d, entries=1, sequenceid=23, filesize=5.0 K 2023-03-20 10:56:18,308 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c42ba4a29d72a9f860b2395947daeb4a in 1322ms, sequenceid=23, compaction requested=true 2023-03-20 10:56:18,308 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:18,308 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:18,308 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-20 10:56:18,704 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/c3e6193c8c334d0f9838a900c4c18847 2023-03-20 10:56:18,705 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/71f7729e66a54b85aeaa5e555660ed0c 2023-03-20 10:56:18,708 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3e6193c8c334d0f9838a900c4c18847 2023-03-20 10:56:18,708 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71f7729e66a54b85aeaa5e555660ed0c 2023-03-20 10:56:18,709 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/5164e5bb2a544bcaab845c2e652539ac as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5164e5bb2a544bcaab845c2e652539ac 2023-03-20 10:56:18,709 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/dbc9a19b3759416db81816c9a5385c4b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/dbc9a19b3759416db81816c9a5385c4b 2023-03-20 10:56:18,731 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbc9a19b3759416db81816c9a5385c4b 2023-03-20 10:56:18,731 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/dbc9a19b3759416db81816c9a5385c4b, entries=3, sequenceid=23, filesize=5.2 K 2023-03-20 10:56:18,732 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/71f7729e66a54b85aeaa5e555660ed0c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/71f7729e66a54b85aeaa5e555660ed0c 2023-03-20 10:56:18,735 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71f7729e66a54b85aeaa5e555660ed0c 2023-03-20 10:56:18,735 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/71f7729e66a54b85aeaa5e555660ed0c, entries=1, sequenceid=23, filesize=5.0 K 2023-03-20 10:56:18,736 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5164e5bb2a544bcaab845c2e652539ac 2023-03-20 10:56:18,736 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5164e5bb2a544bcaab845c2e652539ac, entries=3, sequenceid=23, filesize=5.2 K 2023-03-20 10:56:18,737 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/c3e6193c8c334d0f9838a900c4c18847 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c3e6193c8c334d0f9838a900c4c18847 2023-03-20 10:56:18,740 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3e6193c8c334d0f9838a900c4c18847 2023-03-20 10:56:18,741 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c3e6193c8c334d0f9838a900c4c18847, entries=1, sequenceid=23, filesize=5.0 K 2023-03-20 10:56:18,745 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 37397f8d9cd9e81f41b688f4ba4a02df in 1755ms, sequenceid=23, compaction requested=true 2023-03-20 10:56:18,746 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:18,746 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:18,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-20 10:56:18,746 INFO [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3f7abb66b37c7d8d5eae5e6ae9446c14 in 1752ms, sequenceid=23, compaction requested=true 2023-03-20 10:56:18,746 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:18,746 DEBUG [rs(jenkins-hbase20.apache.org,44189,1679309623230)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:18,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-20 10:56:18,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-20 10:56:18,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-20 10:56:18,746 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-20 10:56:18,747 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,748 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:18,748 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,748 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-20 10:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:18,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:18,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44189,1679309623230' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-20 10:56:18,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67b4bf5a[Count = 0] remaining members to acquire global barrier 2023-03-20 10:56:18,750 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-20 10:56:18,750 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,750 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,750 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-20 10:56:18,750 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-20 10:56:18,750 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44189,1679309623230' in zk 2023-03-20 10:56:18,750 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,751 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-20 10:56:18,751 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:18,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:18,751 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-20 10:56:18,751 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:18,751 DEBUG [member: 'jenkins-hbase20.apache.org,44189,1679309623230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-20 10:56:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44189,1679309623230': 2023-03-20 10:56:18,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44189,1679309623230' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-20 10:56:18,754 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-20 10:56:18,754 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-20 10:56:18,754 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-20 10:56:18,754 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-20 10:56:18,754 INFO [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-20 10:56:18,755 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,755 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-20 10:56:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-20 10:56:18,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,755 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:18,756 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-20 10:56:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-20 10:56:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:18,757 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-20 10:56:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-20 10:56:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:18,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,759 DEBUG [(jenkins-hbase20.apache.org,39971,1679309621485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-20 10:56:18,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-20 10:56:18,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-20 10:56:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-20 10:56:18,759 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-20 10:56:18,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-20 10:56:18,760 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-20 10:56:18,760 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-20 10:56:18,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-20 10:56:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-20 10:56:18,860 DEBUG [Listener at localhost.localdomain/43657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-20 10:56:18,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-20 10:56:18,861 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:56:18,861 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): c42ba4a29d72a9f860b2395947daeb4a/family1 is initiating major compaction (all files) 2023-03-20 10:56:18,861 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:56:18,861 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:56:18,862 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of c42ba4a29d72a9f860b2395947daeb4a/family1 in testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:18,862 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/2e978dc1715c4e368875695beb46f4ba, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/7051ddf3abb344f3a2f56a09dffd8d26, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/705d4a34af5e4eb7bd1dc7319a3de862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/b2d4d9ee306d45beab116969d839973a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/525900de037c4ca99561dd2a06524d32] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp, totalSize=27.1 K 2023-03-20 10:56:18,862 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 2e978dc1715c4e368875695beb46f4ba, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309770504 2023-03-20 10:56:18,863 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 7051ddf3abb344f3a2f56a09dffd8d26, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309772201 2023-03-20 10:56:18,863 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 705d4a34af5e4eb7bd1dc7319a3de862, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309773841 2023-03-20 10:56:18,863 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting b2d4d9ee306d45beab116969d839973a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309774876 2023-03-20 10:56:18,864 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 525900de037c4ca99561dd2a06524d32, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:56:18,876 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): c42ba4a29d72a9f860b2395947daeb4a#family1#compaction#198 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:19,316 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del 2023-03-20 10:56:19,316 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del 2023-03-20 10:56:20,169 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3937e5e3b46544cfb112d0cb17e5008a 2023-03-20 10:56:20,170 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family1/3937e5e3b46544cfb112d0cb17e5008a as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/3937e5e3b46544cfb112d0cb17e5008a 2023-03-20 10:56:20,193 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3937e5e3b46544cfb112d0cb17e5008a 2023-03-20 10:56:20,193 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c42ba4a29d72a9f860b2395947daeb4a/family1 of c42ba4a29d72a9f860b2395947daeb4a into 3937e5e3b46544cfb112d0cb17e5008a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:56:20,194 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:20,194 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:56:20,194 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): c42ba4a29d72a9f860b2395947daeb4a/family2 is initiating major compaction (all files) 2023-03-20 10:56:20,194 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:56:20,194 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:56:20,194 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of c42ba4a29d72a9f860b2395947daeb4a/family2 in testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:20,194 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/3d86619fd0bb4cae98dfdeb77d093ef8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/0cf3ac47b5a14a7dbad98cf4df706464, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/592516ec30b04b33b93d6d7ef6663c21, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/460000288c844fecabc98458d6dc9e20, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/9f942fcb153b4e5b8fb5995ecc92863d] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp, totalSize=25.4 K 2023-03-20 10:56:20,195 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3d86619fd0bb4cae98dfdeb77d093ef8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309770504 2023-03-20 10:56:20,195 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 0cf3ac47b5a14a7dbad98cf4df706464, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309772201 2023-03-20 10:56:20,195 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 592516ec30b04b33b93d6d7ef6663c21, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309773841 2023-03-20 10:56:20,196 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 460000288c844fecabc98458d6dc9e20, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309774876 2023-03-20 10:56:20,196 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 9f942fcb153b4e5b8fb5995ecc92863d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:56:20,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/2e978dc1715c4e368875695beb46f4ba, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/7051ddf3abb344f3a2f56a09dffd8d26, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/705d4a34af5e4eb7bd1dc7319a3de862, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/b2d4d9ee306d45beab116969d839973a, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/525900de037c4ca99561dd2a06524d32] to archive 2023-03-20 10:56:20,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:20,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/2e978dc1715c4e368875695beb46f4ba to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/2e978dc1715c4e368875695beb46f4ba 2023-03-20 10:56:20,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/7051ddf3abb344f3a2f56a09dffd8d26 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/7051ddf3abb344f3a2f56a09dffd8d26 2023-03-20 10:56:20,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/705d4a34af5e4eb7bd1dc7319a3de862 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/705d4a34af5e4eb7bd1dc7319a3de862 2023-03-20 10:56:20,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/b2d4d9ee306d45beab116969d839973a to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/b2d4d9ee306d45beab116969d839973a 2023-03-20 10:56:20,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/525900de037c4ca99561dd2a06524d32 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/525900de037c4ca99561dd2a06524d32 2023-03-20 10:56:20,203 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): c42ba4a29d72a9f860b2395947daeb4a#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:20,613 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230320481486d9ba6d47c4b3b64f6277508373_del 2023-03-20 10:56:20,613 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320481486d9ba6d47c4b3b64f6277508373_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230320481486d9ba6d47c4b3b64f6277508373_del 2023-03-20 10:56:21,434 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d3d5af533d14951bd48096f2cd8565b 2023-03-20 10:56:21,435 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/.tmp/family2/8d3d5af533d14951bd48096f2cd8565b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/8d3d5af533d14951bd48096f2cd8565b 2023-03-20 10:56:21,438 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d3d5af533d14951bd48096f2cd8565b 2023-03-20 10:56:21,439 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c42ba4a29d72a9f860b2395947daeb4a/family2 of c42ba4a29d72a9f860b2395947daeb4a into 8d3d5af533d14951bd48096f2cd8565b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:56:21,439 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:21,439 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:56:21,440 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): 37397f8d9cd9e81f41b688f4ba4a02df/family1 is initiating major compaction (all files) 2023-03-20 10:56:21,440 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:56:21,440 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:56:21,440 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of 37397f8d9cd9e81f41b688f4ba4a02df/family1 in testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:21,440 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/1f76984f7dd740689c78e887fc860978, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/f9e8ce58f511412f9b32f86d6f019c4d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/2b6e9dce958648cbbdb172d6e9a4481d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/e1209e161eec407fb3fa923c0e4cdc8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/dbc9a19b3759416db81816c9a5385c4b] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp, totalSize=27.1 K 2023-03-20 10:56:21,440 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 1f76984f7dd740689c78e887fc860978, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309770505 2023-03-20 10:56:21,441 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting f9e8ce58f511412f9b32f86d6f019c4d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309772202 2023-03-20 10:56:21,441 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 2b6e9dce958648cbbdb172d6e9a4481d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309773841 2023-03-20 10:56:21,441 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting e1209e161eec407fb3fa923c0e4cdc8b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309774877 2023-03-20 10:56:21,441 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting dbc9a19b3759416db81816c9a5385c4b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:56:21,448 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): 37397f8d9cd9e81f41b688f4ba4a02df#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:21,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/3d86619fd0bb4cae98dfdeb77d093ef8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/0cf3ac47b5a14a7dbad98cf4df706464, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/592516ec30b04b33b93d6d7ef6663c21, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/460000288c844fecabc98458d6dc9e20, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/9f942fcb153b4e5b8fb5995ecc92863d] to archive 2023-03-20 10:56:21,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:21,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/3d86619fd0bb4cae98dfdeb77d093ef8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/3d86619fd0bb4cae98dfdeb77d093ef8 2023-03-20 10:56:21,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/0cf3ac47b5a14a7dbad98cf4df706464 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/0cf3ac47b5a14a7dbad98cf4df706464 2023-03-20 10:56:21,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/592516ec30b04b33b93d6d7ef6663c21 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/592516ec30b04b33b93d6d7ef6663c21 2023-03-20 10:56:21,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/460000288c844fecabc98458d6dc9e20 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/460000288c844fecabc98458d6dc9e20 2023-03-20 10:56:21,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/9f942fcb153b4e5b8fb5995ecc92863d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family2/9f942fcb153b4e5b8fb5995ecc92863d 2023-03-20 10:56:21,890 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del 2023-03-20 10:56:21,890 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del 2023-03-20 10:56:22,741 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20fe2912b96d446597fb07523f992bda 2023-03-20 10:56:22,742 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family1/20fe2912b96d446597fb07523f992bda as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/20fe2912b96d446597fb07523f992bda 2023-03-20 10:56:22,767 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20fe2912b96d446597fb07523f992bda 2023-03-20 10:56:22,768 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 37397f8d9cd9e81f41b688f4ba4a02df/family1 of 37397f8d9cd9e81f41b688f4ba4a02df into 20fe2912b96d446597fb07523f992bda(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:56:22,768 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:22,768 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:56:22,769 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): 37397f8d9cd9e81f41b688f4ba4a02df/family2 is initiating major compaction (all files) 2023-03-20 10:56:22,769 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:56:22,769 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:56:22,770 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of 37397f8d9cd9e81f41b688f4ba4a02df/family2 in testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:22,771 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/ca8d6ac90b074aea974f9f1f513cee8f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/37acf7a516bd48beac04d28791e3252f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/9b740885fa50462c8fae04a51103fccf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/684d359c029447c5881da62c563d31cd, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/71f7729e66a54b85aeaa5e555660ed0c] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp, totalSize=25.4 K 2023-03-20 10:56:22,772 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting ca8d6ac90b074aea974f9f1f513cee8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309770505 2023-03-20 10:56:22,772 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 37acf7a516bd48beac04d28791e3252f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309772202 2023-03-20 10:56:22,773 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 9b740885fa50462c8fae04a51103fccf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309773841 2023-03-20 10:56:22,773 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 684d359c029447c5881da62c563d31cd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309774877 2023-03-20 10:56:22,773 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 71f7729e66a54b85aeaa5e555660ed0c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:56:22,784 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): 37397f8d9cd9e81f41b688f4ba4a02df#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:22,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/1f76984f7dd740689c78e887fc860978, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/f9e8ce58f511412f9b32f86d6f019c4d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/2b6e9dce958648cbbdb172d6e9a4481d, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/e1209e161eec407fb3fa923c0e4cdc8b, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/dbc9a19b3759416db81816c9a5385c4b] to archive 2023-03-20 10:56:22,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:22,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/1f76984f7dd740689c78e887fc860978 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/1f76984f7dd740689c78e887fc860978 2023-03-20 10:56:22,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/f9e8ce58f511412f9b32f86d6f019c4d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/f9e8ce58f511412f9b32f86d6f019c4d 2023-03-20 10:56:22,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/2b6e9dce958648cbbdb172d6e9a4481d to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/2b6e9dce958648cbbdb172d6e9a4481d 2023-03-20 10:56:22,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/e1209e161eec407fb3fa923c0e4cdc8b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/e1209e161eec407fb3fa923c0e4cdc8b 2023-03-20 10:56:22,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/dbc9a19b3759416db81816c9a5385c4b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/dbc9a19b3759416db81816c9a5385c4b 2023-03-20 10:56:23,196 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303205ff3751d206449968259c5768bf0434c_del 2023-03-20 10:56:23,196 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303205ff3751d206449968259c5768bf0434c_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303205ff3751d206449968259c5768bf0434c_del 2023-03-20 10:56:24,042 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69095ea63fb44d70b191d0686f1362d0 2023-03-20 10:56:24,043 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/.tmp/family2/69095ea63fb44d70b191d0686f1362d0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/69095ea63fb44d70b191d0686f1362d0 2023-03-20 10:56:24,047 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69095ea63fb44d70b191d0686f1362d0 2023-03-20 10:56:24,049 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 37397f8d9cd9e81f41b688f4ba4a02df/family2 of 37397f8d9cd9e81f41b688f4ba4a02df into 69095ea63fb44d70b191d0686f1362d0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-20 10:56:24,049 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:24,049 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:56:24,049 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 is initiating major compaction (all files) 2023-03-20 10:56:24,050 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:56:24,050 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:56:24,050 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 in testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:24,050 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/9185e8d0156446808f1886ab5aeeaa81, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/68bb00be771c4a21bd74428301f5c775, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/08a33462f73c4d5fb5086a636e5cc11e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5164e5bb2a544bcaab845c2e652539ac] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp, totalSize=27.1 K 2023-03-20 10:56:24,051 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 9185e8d0156446808f1886ab5aeeaa81, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309770505 2023-03-20 10:56:24,054 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 68bb00be771c4a21bd74428301f5c775, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309772202 2023-03-20 10:56:24,055 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 0d4fd209b58d4bcca9bd556f4d0ea5e8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309773841 2023-03-20 10:56:24,056 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 08a33462f73c4d5fb5086a636e5cc11e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309774877 2023-03-20 10:56:24,059 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 5164e5bb2a544bcaab845c2e652539ac, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:56:24,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/ca8d6ac90b074aea974f9f1f513cee8f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/37acf7a516bd48beac04d28791e3252f, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/9b740885fa50462c8fae04a51103fccf, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/684d359c029447c5881da62c563d31cd, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/71f7729e66a54b85aeaa5e555660ed0c] to archive 2023-03-20 10:56:24,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:24,103 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): 3f7abb66b37c7d8d5eae5e6ae9446c14#family1#compaction#202 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:24,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/ca8d6ac90b074aea974f9f1f513cee8f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/ca8d6ac90b074aea974f9f1f513cee8f 2023-03-20 10:56:24,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/37acf7a516bd48beac04d28791e3252f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/37acf7a516bd48beac04d28791e3252f 2023-03-20 10:56:24,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/9b740885fa50462c8fae04a51103fccf to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/9b740885fa50462c8fae04a51103fccf 2023-03-20 10:56:24,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/684d359c029447c5881da62c563d31cd to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/684d359c029447c5881da62c563d31cd 2023-03-20 10:56:24,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/71f7729e66a54b85aeaa5e555660ed0c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family2/71f7729e66a54b85aeaa5e555660ed0c 2023-03-20 10:56:24,591 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del 2023-03-20 10:56:24,591 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del 2023-03-20 10:56:24,700 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfe520485f094d128bfece3623135567 2023-03-20 10:56:24,701 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family1/bfe520485f094d128bfece3623135567 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/bfe520485f094d128bfece3623135567 2023-03-20 10:56:24,768 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfe520485f094d128bfece3623135567 2023-03-20 10:56:24,770 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 of 3f7abb66b37c7d8d5eae5e6ae9446c14 into bfe520485f094d128bfece3623135567(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:56:24,770 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:24,770 DEBUG [Listener at localhost.localdomain/43657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-20 10:56:24,770 DEBUG [Listener at localhost.localdomain/43657] regionserver.HStore(1912): 3f7abb66b37c7d8d5eae5e6ae9446c14/family2 is initiating major compaction (all files) 2023-03-20 10:56:24,770 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-20 10:56:24,770 INFO [Listener at localhost.localdomain/43657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-20 10:56:24,771 INFO [Listener at localhost.localdomain/43657] regionserver.HRegion(2259): Starting compaction of 3f7abb66b37c7d8d5eae5e6ae9446c14/family2 in testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:24,771 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/b8756aa76ac145fb850ceeded48be080, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/7db5b198ce364c55a9448b93a7eea771, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/3ca91c8e560f4cc8a9aa4276b8525bb0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c5b77fe15cf14073ae483199a9d3dfa7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c3e6193c8c334d0f9838a900c4c18847] into tmpdir=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp, totalSize=25.4 K 2023-03-20 10:56:24,774 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting b8756aa76ac145fb850ceeded48be080, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679309770505 2023-03-20 10:56:24,780 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 7db5b198ce364c55a9448b93a7eea771, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679309772202 2023-03-20 10:56:24,785 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting 3ca91c8e560f4cc8a9aa4276b8525bb0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679309773841 2023-03-20 10:56:24,790 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting c5b77fe15cf14073ae483199a9d3dfa7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679309774877 2023-03-20 10:56:24,797 DEBUG [Listener at localhost.localdomain/43657] compactions.Compactor(207): Compacting c3e6193c8c334d0f9838a900c4c18847, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-20 10:56:24,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/9185e8d0156446808f1886ab5aeeaa81, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/68bb00be771c4a21bd74428301f5c775, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/08a33462f73c4d5fb5086a636e5cc11e, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5164e5bb2a544bcaab845c2e652539ac] to archive 2023-03-20 10:56:24,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:24,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/9185e8d0156446808f1886ab5aeeaa81 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/9185e8d0156446808f1886ab5aeeaa81 2023-03-20 10:56:24,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/68bb00be771c4a21bd74428301f5c775 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/68bb00be771c4a21bd74428301f5c775 2023-03-20 10:56:24,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/0d4fd209b58d4bcca9bd556f4d0ea5e8 2023-03-20 10:56:24,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/08a33462f73c4d5fb5086a636e5cc11e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/08a33462f73c4d5fb5086a636e5cc11e 2023-03-20 10:56:24,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5164e5bb2a544bcaab845c2e652539ac to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5164e5bb2a544bcaab845c2e652539ac 2023-03-20 10:56:24,882 INFO [Listener at localhost.localdomain/43657] throttle.PressureAwareThroughputController(145): 3f7abb66b37c7d8d5eae5e6ae9446c14#family2#compaction#203 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-20 10:56:24,920 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303208164f1bc48bb47c2a5392b9d92bb31de_del 2023-03-20 10:56:24,920 INFO [Listener at localhost.localdomain/43657] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303208164f1bc48bb47c2a5392b9d92bb31de_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303208164f1bc48bb47c2a5392b9d92bb31de_del 2023-03-20 10:56:25,744 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54861415627b4c9281c0a2f3addf2a44 2023-03-20 10:56:25,745 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/.tmp/family2/54861415627b4c9281c0a2f3addf2a44 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/54861415627b4c9281c0a2f3addf2a44 2023-03-20 10:56:25,763 INFO [Listener at localhost.localdomain/43657] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54861415627b4c9281c0a2f3addf2a44 2023-03-20 10:56:25,765 INFO [Listener at localhost.localdomain/43657] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3f7abb66b37c7d8d5eae5e6ae9446c14/family2 of 3f7abb66b37c7d8d5eae5e6ae9446c14 into 54861415627b4c9281c0a2f3addf2a44(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-20 10:56:25,765 DEBUG [Listener at localhost.localdomain/43657] regionserver.HRegion(2289): Compaction status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:25,771 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:56:25,779 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:56:25,789 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:56:25,790 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:56:25,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/b8756aa76ac145fb850ceeded48be080, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/7db5b198ce364c55a9448b93a7eea771, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/3ca91c8e560f4cc8a9aa4276b8525bb0, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c5b77fe15cf14073ae483199a9d3dfa7, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c3e6193c8c334d0f9838a900c4c18847] to archive 2023-03-20 10:56:25,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:25,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/b8756aa76ac145fb850ceeded48be080 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/b8756aa76ac145fb850ceeded48be080 2023-03-20 10:56:25,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/7db5b198ce364c55a9448b93a7eea771 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/7db5b198ce364c55a9448b93a7eea771 2023-03-20 10:56:25,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/3ca91c8e560f4cc8a9aa4276b8525bb0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/3ca91c8e560f4cc8a9aa4276b8525bb0 2023-03-20 10:56:25,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c5b77fe15cf14073ae483199a9d3dfa7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c5b77fe15cf14073ae483199a9d3dfa7 2023-03-20 10:56:25,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c3e6193c8c334d0f9838a900c4c18847 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family2/c3e6193c8c334d0f9838a900c4c18847 2023-03-20 10:56:25,816 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39971] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD1\xFD\x11\xCC\x1E\x1F\x90\xDA\xAF\xD7\xD1\xBC\x8Al\x11\xE7"\x10gQQ{m\x90\xBA\xECv\x1A\x18\xD4\xFF\x8Dl\xE7*\x10\xAFF\x11\xDF\xABC\xF9\xD3j\xE2\x10\x12\x8B\xEA\xD7\xF02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-20 10:56:25,846 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-20 10:56:25,847 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-20 10:56:25,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:56:25,848 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679310385848 2023-03-20 10:56:25,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-20 10:56:26,456 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-20 10:56:26,488 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del 2023-03-20 10:56:26,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del 2023-03-20 10:56:26,540 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del 2023-03-20 10:56:26,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:26,541 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] zookeeper.ReadOnlyZKClient(139): Connect 0x74d02494 to 127.0.0.1:62837 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-20 10:56:26,574 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b24f492, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-20 10:56:26,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230320 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:26,837 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230320a676df63c24c4623980d8fc9ae81800e to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320a676df63c24c4623980d8fc9ae81800e 2023-03-20 10:56:26,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:26,855 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-20 10:56:26,860 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59074, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-20 10:56:26,871 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-20 10:56:26,873 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-20 10:56:26,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230320/family1/2eab40672657449fa9f2ed787045f86c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-20 10:56:26,916 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230320/family1/2eab40672657449fa9f2ed787045f86c}] 2023-03-20 10:56:26,925 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230320/family1/2eab40672657449fa9f2ed787045f86c for inclusion in 37397f8d9cd9e81f41b688f4ba4a02df/family1 2023-03-20 10:56:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-20 10:56:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-20 10:56:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:26,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230320/family1/2eab40672657449fa9f2ed787045f86c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__15k5j0jmdmgb3aerqtknhvf19n6ra2g00u0m20on2omgb3nevrnkqcvb4d942c89/family1/2eab40672657449fa9f2ed787045f86c 2023-03-20 10:56:26,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__15k5j0jmdmgb3aerqtknhvf19n6ra2g00u0m20on2omgb3nevrnkqcvb4d942c89/family1/2eab40672657449fa9f2ed787045f86c as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/5a981916230f46d49fa2d31a890e30ef_SeqId_28_ 2023-03-20 10:56:26,959 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__15k5j0jmdmgb3aerqtknhvf19n6ra2g00u0m20on2omgb3nevrnkqcvb4d942c89/family1/2eab40672657449fa9f2ed787045f86c into 37397f8d9cd9e81f41b688f4ba4a02df/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/5a981916230f46d49fa2d31a890e30ef_SeqId_28_ - updating store file list. 2023-03-20 10:56:27,000 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/5a981916230f46d49fa2d31a890e30ef_SeqId_28_ into 37397f8d9cd9e81f41b688f4ba4a02df/family1 2023-03-20 10:56:27,000 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__15k5j0jmdmgb3aerqtknhvf19n6ra2g00u0m20on2omgb3nevrnkqcvb4d942c89/family1/2eab40672657449fa9f2ed787045f86c into 37397f8d9cd9e81f41b688f4ba4a02df/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/family1/5a981916230f46d49fa2d31a890e30ef_SeqId_28_) 2023-03-20 10:56:27,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__15k5j0jmdmgb3aerqtknhvf19n6ra2g00u0m20on2omgb3nevrnkqcvb4d942c89/family1/2eab40672657449fa9f2ed787045f86c 2023-03-20 10:56:27,003 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230320 table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:27,004 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:27,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023032015d57f02c6744b9fbff3812a1b553c1f to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023032015d57f02c6744b9fbff3812a1b553c1f 2023-03-20 10:56:27,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303201cbac59660054419810d1c41277b3776 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303201cbac59660054419810d1c41277b3776 2023-03-20 10:56:27,008 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320988403ce05a64256b0a9415c0497a5d7 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320988403ce05a64256b0a9415c0497a5d7 2023-03-20 10:56:27,009 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320fcf4b7a04dbb429aa09e911313ccdae3 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320fcf4b7a04dbb429aa09e911313ccdae3 2023-03-20 10:56:27,009 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-20 10:56:27,009 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230320' 2023-03-20 10:56:27,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230320 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:27,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230320 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:28,072 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230320b591b496e9e24aabb5ed9993569070dc to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320b591b496e9e24aabb5ed9993569070dc 2023-03-20 10:56:28,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:28,200 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230320/family1/751dbf3932964c28b25c71c9b39a757b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-20 10:56:28,201 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230320/family1/751dbf3932964c28b25c71c9b39a757b}] 2023-03-20 10:56:28,204 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230320/family1/751dbf3932964c28b25c71c9b39a757b for inclusion in 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 2023-03-20 10:56:28,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-20 10:56:28,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-20 10:56:28,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:28,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230320/family1/751dbf3932964c28b25c71c9b39a757b to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__1j644kv2ge56n9p9vglpn0kitd1ct3d9k34osuvne3nb2occc5tgcate5ggqjo88/family1/751dbf3932964c28b25c71c9b39a757b 2023-03-20 10:56:28,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__1j644kv2ge56n9p9vglpn0kitd1ct3d9k34osuvne3nb2occc5tgcate5ggqjo88/family1/751dbf3932964c28b25c71c9b39a757b as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5c66fff1a15247669369dab912011da9_SeqId_28_ 2023-03-20 10:56:28,235 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__1j644kv2ge56n9p9vglpn0kitd1ct3d9k34osuvne3nb2occc5tgcate5ggqjo88/family1/751dbf3932964c28b25c71c9b39a757b into 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5c66fff1a15247669369dab912011da9_SeqId_28_ - updating store file list. 2023-03-20 10:56:28,269 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5c66fff1a15247669369dab912011da9_SeqId_28_ into 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 2023-03-20 10:56:28,269 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__1j644kv2ge56n9p9vglpn0kitd1ct3d9k34osuvne3nb2occc5tgcate5ggqjo88/family1/751dbf3932964c28b25c71c9b39a757b into 3f7abb66b37c7d8d5eae5e6ae9446c14/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/family1/5c66fff1a15247669369dab912011da9_SeqId_28_) 2023-03-20 10:56:28,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__1j644kv2ge56n9p9vglpn0kitd1ct3d9k34osuvne3nb2occc5tgcate5ggqjo88/family1/751dbf3932964c28b25c71c9b39a757b 2023-03-20 10:56:28,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230320 table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:28,274 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:28,277 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032058fcf50a1d1a44939c19ea49edf3c454 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032058fcf50a1d1a44939c19ea49edf3c454 2023-03-20 10:56:28,279 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032059427cee947d4618b5451929ced414d8 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032059427cee947d4618b5451929ced414d8 2023-03-20 10:56:28,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320854a8ffa37e947809e223e566c9ff6af to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320854a8ffa37e947809e223e566c9ff6af 2023-03-20 10:56:28,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320b251b667b74c470c8267fbbb18129e22 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230320b251b667b74c470c8267fbbb18129e22 2023-03-20 10:56:28,289 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-20 10:56:28,289 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230320' 2023-03-20 10:56:28,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230320 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:28,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230320 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:28,318 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-20 10:56:29,264 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-20 10:56:29,358 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230320c2b0650c7c404473a56b4d85a8b59b74 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320c2b0650c7c404473a56b4d85a8b59b74 2023-03-20 10:56:29,359 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:29,407 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230320/family1/f24bfccc761e4a2fb617780122b83034 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-20 10:56:29,408 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a., hostname=jenkins-hbase20.apache.org,44189,1679309623230, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230320/family1/f24bfccc761e4a2fb617780122b83034}] 2023-03-20 10:56:29,410 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230320/family1/f24bfccc761e4a2fb617780122b83034 for inclusion in c42ba4a29d72a9f860b2395947daeb4a/family1 2023-03-20 10:56:29,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-20 10:56:29,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(777): Region bounds: first= last=1 2023-03-20 10:56:29,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegion(2446): Flush status journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:29,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230320/family1/f24bfccc761e4a2fb617780122b83034 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__364h4s9bt9op6uch5cm135bhrtpocbob7e8151dppkcljh7k79qsk6vdhlb3i4jo/family1/f24bfccc761e4a2fb617780122b83034 2023-03-20 10:56:29,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__364h4s9bt9op6uch5cm135bhrtpocbob7e8151dppkcljh7k79qsk6vdhlb3i4jo/family1/f24bfccc761e4a2fb617780122b83034 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/ec4d0ef70dcb41c99d5ecc76ae6e753d_SeqId_28_ 2023-03-20 10:56:29,438 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__364h4s9bt9op6uch5cm135bhrtpocbob7e8151dppkcljh7k79qsk6vdhlb3i4jo/family1/f24bfccc761e4a2fb617780122b83034 into c42ba4a29d72a9f860b2395947daeb4a/family1 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/ec4d0ef70dcb41c99d5ecc76ae6e753d_SeqId_28_ - updating store file list. 2023-03-20 10:56:29,465 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/ec4d0ef70dcb41c99d5ecc76ae6e753d_SeqId_28_ into c42ba4a29d72a9f860b2395947daeb4a/family1 2023-03-20 10:56:29,465 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__364h4s9bt9op6uch5cm135bhrtpocbob7e8151dppkcljh7k79qsk6vdhlb3i4jo/family1/f24bfccc761e4a2fb617780122b83034 into c42ba4a29d72a9f860b2395947daeb4a/family1 (new location: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/family1/ec4d0ef70dcb41c99d5ecc76ae6e753d_SeqId_28_) 2023-03-20 10:56:29,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44189] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/staging/jenkins__testMajorCompactionFromAdmin__364h4s9bt9op6uch5cm135bhrtpocbob7e8151dppkcljh7k79qsk6vdhlb3i4jo/family1/f24bfccc761e4a2fb617780122b83034 2023-03-20 10:56:29,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230320 table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:29,469 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:29,470 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320c5f4f06088744728927394e6c986fb34 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320c5f4f06088744728927394e6c986fb34 2023-03-20 10:56:29,471 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320cadbfc9e1eb043fdbd8277aac5df8305 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320cadbfc9e1eb043fdbd8277aac5df8305 2023-03-20 10:56:29,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320d6c8529641974bb7af2423408c371e7c to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320d6c8529641974bb7af2423408c371e7c 2023-03-20 10:56:29,475 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320e10557ae5e8c449c901938872afc0aa0 to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230320e10557ae5e8c449c901938872afc0aa0 2023-03-20 10:56:29,475 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-20 10:56:29,475 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230320' 2023-03-20 10:56:29,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230320 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:29,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-20 10:56:29,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-20 10:56:29,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del] 2023-03-20 10:56:29,476 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:29,476 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032034f42e197693483e9a15f12f1804d968_del 2023-03-20 10:56:29,477 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-20 10:56:29,477 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del] 2023-03-20 10:56:29,477 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:29,478 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230320142d5908ce9742b6a36313b3499b673e_del 2023-03-20 10:56:29,478 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-20 10:56:29,478 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del] 2023-03-20 10:56:29,478 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] backup.HFileArchiver(360): Archiving compacted files. 2023-03-20 10:56:29,479 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del to hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303209596001d78fa46a6904f6162d734669b_del 2023-03-20 10:56:29,479 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-20 10:56:29,479 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679309627555] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-20 10:56:29,480 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-20 10:56:29,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.6350 sec 2023-03-20 10:56:29,499 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:56:29,501 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:56:29,510 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-20 10:56:29,512 DEBUG [Listener at localhost.localdomain/43657] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-20 10:56:29,516 INFO [Listener at localhost.localdomain/43657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-20 10:56:29,580 INFO [Listener at localhost.localdomain/43657] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 255), OpenFileDescriptor=617 (was 640), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=425 (was 393) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=9346 (was 8581) - AvailableMemoryMB LEAK? - 2023-03-20 10:56:29,581 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f820396 to 127.0.0.1:62837 2023-03-20 10:56:29,581 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:29,581 INFO [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-20 10:56:29,581 INFO [Listener at localhost.localdomain/43657] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-20 10:56:29,582 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11ea4006 to 127.0.0.1:62837 2023-03-20 10:56:29,582 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:29,584 DEBUG [Listener at localhost.localdomain/43657] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-20 10:56:29,584 DEBUG [Listener at localhost.localdomain/43657] util.JVMClusterUtil(257): Found active master hash=339423979, stopped=false 2023-03-20 10:56:29,584 INFO [Listener at localhost.localdomain/43657] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:56:29,684 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-20 10:56:29,684 INFO [Listener at localhost.localdomain/43657] procedure2.ProcedureExecutor(629): Stopping 2023-03-20 10:56:29,684 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:56:29,684 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-20 10:56:29,684 DEBUG [Listener at localhost.localdomain/43657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0edd2357 to 127.0.0.1:62837 2023-03-20 10:56:29,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-20 10:56:29,684 DEBUG [Listener at localhost.localdomain/43657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:29,684 INFO [Listener at localhost.localdomain/43657] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44189,1679309623230' ***** 2023-03-20 10:56:29,684 INFO [Listener at localhost.localdomain/43657] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-20 10:56:29,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] regionserver.HeapMemoryManager(220): Stopping 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-20 10:56:29,685 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 1a39e1d017ce37e865c8dff1d0d345bf 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for af00e67c6039a735f18797dedd567132 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for d6d1d1bb207a093cc32d1ceea5d628b3 2023-03-20 10:56:29,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1a39e1d017ce37e865c8dff1d0d345bf, disabling compactions & flushes 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for a04bc7a14af3f2e7ba8b032f09927293 2023-03-20 10:56:29,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:56:29,685 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for c00186bd850f4540e39bc2caef12c922 2023-03-20 10:56:29,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 3c8cd4be4947fdf88edb1fdf8adc4035 2023-03-20 10:56:29,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. after waiting 0 ms 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for b297fedee688520fa896c9eed857babd 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for c42ba4a29d72a9f860b2395947daeb4a 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 1c1e9acaa26c9ee69458ec3df6c75ea8 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 00d90e2015616273fc20d11ce70eed5e 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 37397f8d9cd9e81f41b688f4ba4a02df 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 13d22083541370fcb2ebc25e6603a946 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 3f7abb66b37c7d8d5eae5e6ae9446c14 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for cb051e8df6af553f31841872b29bc531 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 75a8b4d7351e02dabf5bd0e1f8bbe1ec 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for a5a7eb0c16894ccc2304d0ab4b06501b 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 2d9e3cf84600d62e9e4feea6fe7edd27 2023-03-20 10:56:29,686 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:29,686 DEBUG [RS:0;jenkins-hbase20:44189] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ee4c951 to 127.0.0.1:62837 2023-03-20 10:56:29,687 DEBUG [RS:0;jenkins-hbase20:44189] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:29,691 INFO [RS:0;jenkins-hbase20:44189] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-20 10:56:29,691 INFO [RS:0;jenkins-hbase20:44189] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-20 10:56:29,691 INFO [RS:0;jenkins-hbase20:44189] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-20 10:56:29,692 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-20 10:56:29,692 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-20 10:56:29,693 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1505): Waiting on 00d90e2015616273fc20d11ce70eed5e, 13d22083541370fcb2ebc25e6603a946, 1588230740, 1a39e1d017ce37e865c8dff1d0d345bf, 1c1e9acaa26c9ee69458ec3df6c75ea8, 2d9e3cf84600d62e9e4feea6fe7edd27, 37397f8d9cd9e81f41b688f4ba4a02df, 3c8cd4be4947fdf88edb1fdf8adc4035, 3f7abb66b37c7d8d5eae5e6ae9446c14, 75a8b4d7351e02dabf5bd0e1f8bbe1ec, a04bc7a14af3f2e7ba8b032f09927293, a5a7eb0c16894ccc2304d0ab4b06501b, af00e67c6039a735f18797dedd567132, b297fedee688520fa896c9eed857babd, c00186bd850f4540e39bc2caef12c922, c42ba4a29d72a9f860b2395947daeb4a, cb051e8df6af553f31841872b29bc531, d04a13b1886cbfc7a73fc35394f94d65, d6d1d1bb207a093cc32d1ceea5d628b3, e0ef86d3f8b59492e591fb6178d48b92, e274008ba03fba13d08e97b9fc403e68 2023-03-20 10:56:29,693 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-20 10:56:29,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-20 10:56:29,693 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-20 10:56:29,693 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-20 10:56:29,693 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-20 10:56:29,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-03-20 10:56:29,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:56:29,697 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-20 10:56:29,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1a39e1d017ce37e865c8dff1d0d345bf/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-20 10:56:29,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:56:29,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1a39e1d017ce37e865c8dff1d0d345bf: 2023-03-20 10:56:29,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679309680909.1a39e1d017ce37e865c8dff1d0d345bf. 2023-03-20 10:56:29,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing af00e67c6039a735f18797dedd567132, disabling compactions & flushes 2023-03-20 10:56:29,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:56:29,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:56:29,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. after waiting 0 ms 2023-03-20 10:56:29,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:56:29,713 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-20 10:56:29,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/af00e67c6039a735f18797dedd567132/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-20 10:56:29,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:56:29,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for af00e67c6039a735f18797dedd567132: 2023-03-20 10:56:29,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1679309740005.af00e67c6039a735f18797dedd567132. 2023-03-20 10:56:29,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d6d1d1bb207a093cc32d1ceea5d628b3, disabling compactions & flushes 2023-03-20 10:56:29,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:56:29,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:56:29,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. after waiting 0 ms 2023-03-20 10:56:29,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:56:29,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/d6d1d1bb207a093cc32d1ceea5d628b3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-20 10:56:29,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:56:29,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d6d1d1bb207a093cc32d1ceea5d628b3: 2023-03-20 10:56:29,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1679309740005.d6d1d1bb207a093cc32d1ceea5d628b3. 2023-03-20 10:56:29,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a04bc7a14af3f2e7ba8b032f09927293, disabling compactions & flushes 2023-03-20 10:56:29,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:56:29,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:56:29,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. after waiting 0 ms 2023-03-20 10:56:29,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:56:29,776 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-20 10:56:29,776 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-20 10:56:29,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithWeeklyPolicy/a04bc7a14af3f2e7ba8b032f09927293/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-20 10:56:29,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:56:29,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a04bc7a14af3f2e7ba8b032f09927293: 2023-03-20 10:56:29,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1679309649978.a04bc7a14af3f2e7ba8b032f09927293. 2023-03-20 10:56:29,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c00186bd850f4540e39bc2caef12c922, disabling compactions & flushes 2023-03-20 10:56:29,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:56:29,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:56:29,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. after waiting 0 ms 2023-03-20 10:56:29,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:56:29,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/c00186bd850f4540e39bc2caef12c922/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-20 10:56:29,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:56:29,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c00186bd850f4540e39bc2caef12c922: 2023-03-20 10:56:29,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1679309714175.c00186bd850f4540e39bc2caef12c922. 2023-03-20 10:56:29,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3c8cd4be4947fdf88edb1fdf8adc4035, disabling compactions & flushes 2023-03-20 10:56:29,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:56:29,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:56:29,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. after waiting 0 ms 2023-03-20 10:56:29,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:56:29,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/3c8cd4be4947fdf88edb1fdf8adc4035/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-20 10:56:29,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:56:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3c8cd4be4947fdf88edb1fdf8adc4035: 2023-03-20 10:56:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1679309714175.3c8cd4be4947fdf88edb1fdf8adc4035. 2023-03-20 10:56:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e274008ba03fba13d08e97b9fc403e68, disabling compactions & flushes 2023-03-20 10:56:29,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. after waiting 0 ms 2023-03-20 10:56:29,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:29,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMinorCompactionWithMonthlyPolicy/e274008ba03fba13d08e97b9fc403e68/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-20 10:56:29,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:29,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e274008ba03fba13d08e97b9fc403e68: 2023-03-20 10:56:29,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1679309757179.e274008ba03fba13d08e97b9fc403e68. 2023-03-20 10:56:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b297fedee688520fa896c9eed857babd, disabling compactions & flushes 2023-03-20 10:56:29,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:56:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:56:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. after waiting 0 ms 2023-03-20 10:56:29,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:56:29,894 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1505): Waiting on 00d90e2015616273fc20d11ce70eed5e, 13d22083541370fcb2ebc25e6603a946, 1588230740, 1c1e9acaa26c9ee69458ec3df6c75ea8, 2d9e3cf84600d62e9e4feea6fe7edd27, 37397f8d9cd9e81f41b688f4ba4a02df, 3f7abb66b37c7d8d5eae5e6ae9446c14, 75a8b4d7351e02dabf5bd0e1f8bbe1ec, a5a7eb0c16894ccc2304d0ab4b06501b, b297fedee688520fa896c9eed857babd, c42ba4a29d72a9f860b2395947daeb4a, cb051e8df6af553f31841872b29bc531, d04a13b1886cbfc7a73fc35394f94d65, e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:56:29,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b297fedee688520fa896c9eed857babd/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-20 10:56:29,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:56:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b297fedee688520fa896c9eed857babd: 2023-03-20 10:56:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679309627764.b297fedee688520fa896c9eed857babd. 2023-03-20 10:56:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c42ba4a29d72a9f860b2395947daeb4a, disabling compactions & flushes 2023-03-20 10:56:29,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. after waiting 0 ms 2023-03-20 10:56:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:29,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/c42ba4a29d72a9f860b2395947daeb4a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-20 10:56:29,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:29,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c42ba4a29d72a9f860b2395947daeb4a: 2023-03-20 10:56:29,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1679309768349.c42ba4a29d72a9f860b2395947daeb4a. 2023-03-20 10:56:29,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1c1e9acaa26c9ee69458ec3df6c75ea8, disabling compactions & flushes 2023-03-20 10:56:29,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:56:29,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:56:29,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. after waiting 0 ms 2023-03-20 10:56:29,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:56:29,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1c1e9acaa26c9ee69458ec3df6c75ea8 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-20 10:56:30,094 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1505): Waiting on 00d90e2015616273fc20d11ce70eed5e, 13d22083541370fcb2ebc25e6603a946, 1588230740, 1c1e9acaa26c9ee69458ec3df6c75ea8, 2d9e3cf84600d62e9e4feea6fe7edd27, 37397f8d9cd9e81f41b688f4ba4a02df, 3f7abb66b37c7d8d5eae5e6ae9446c14, 75a8b4d7351e02dabf5bd0e1f8bbe1ec, a5a7eb0c16894ccc2304d0ab4b06501b, cb051e8df6af553f31841872b29bc531, d04a13b1886cbfc7a73fc35394f94d65, e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:56:30,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/.tmp/info/69af440823054d06b503129f200f99fc 2023-03-20 10:56:30,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69af440823054d06b503129f200f99fc 2023-03-20 10:56:30,294 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1505): Waiting on 00d90e2015616273fc20d11ce70eed5e, 13d22083541370fcb2ebc25e6603a946, 1588230740, 1c1e9acaa26c9ee69458ec3df6c75ea8, 2d9e3cf84600d62e9e4feea6fe7edd27, 37397f8d9cd9e81f41b688f4ba4a02df, 3f7abb66b37c7d8d5eae5e6ae9446c14, 75a8b4d7351e02dabf5bd0e1f8bbe1ec, a5a7eb0c16894ccc2304d0ab4b06501b, cb051e8df6af553f31841872b29bc531, d04a13b1886cbfc7a73fc35394f94d65, e0ef86d3f8b59492e591fb6178d48b92 2023-03-20 10:56:30,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/.tmp/info/297d14264a724bdc9ff729d6d110efa4 2023-03-20 10:56:30,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/.tmp/info/297d14264a724bdc9ff729d6d110efa4 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/info/297d14264a724bdc9ff729d6d110efa4 2023-03-20 10:56:30,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/info/297d14264a724bdc9ff729d6d110efa4, entries=3, sequenceid=7, filesize=4.8 K 2023-03-20 10:56:30,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 1c1e9acaa26c9ee69458ec3df6c75ea8 in 464ms, sequenceid=7, compaction requested=false 2023-03-20 10:56:30,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/namespace/1c1e9acaa26c9ee69458ec3df6c75ea8/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-20 10:56:30,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:56:30,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1c1e9acaa26c9ee69458ec3df6c75ea8: 2023-03-20 10:56:30,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1679309626291.1c1e9acaa26c9ee69458ec3df6c75ea8. 2023-03-20 10:56:30,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 00d90e2015616273fc20d11ce70eed5e, disabling compactions & flushes 2023-03-20 10:56:30,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:56:30,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:56:30,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. after waiting 0 ms 2023-03-20 10:56:30,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:56:30,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/00d90e2015616273fc20d11ce70eed5e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-20 10:56:30,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:56:30,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 00d90e2015616273fc20d11ce70eed5e: 2023-03-20 10:56:30,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1679309662364.00d90e2015616273fc20d11ce70eed5e. 2023-03-20 10:56:30,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 37397f8d9cd9e81f41b688f4ba4a02df, disabling compactions & flushes 2023-03-20 10:56:30,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:30,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:30,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. after waiting 0 ms 2023-03-20 10:56:30,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:30,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/37397f8d9cd9e81f41b688f4ba4a02df/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-20 10:56:30,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:30,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 37397f8d9cd9e81f41b688f4ba4a02df: 2023-03-20 10:56:30,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1679309768349.37397f8d9cd9e81f41b688f4ba4a02df. 2023-03-20 10:56:30,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 13d22083541370fcb2ebc25e6603a946, disabling compactions & flushes 2023-03-20 10:56:30,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:56:30,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:56:30,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. after waiting 0 ms 2023-03-20 10:56:30,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:56:30,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/13d22083541370fcb2ebc25e6603a946/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-20 10:56:30,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:56:30,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 13d22083541370fcb2ebc25e6603a946: 2023-03-20 10:56:30,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1679309662364.13d22083541370fcb2ebc25e6603a946. 2023-03-20 10:56:30,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e0ef86d3f8b59492e591fb6178d48b92, disabling compactions & flushes 2023-03-20 10:56:30,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:56:30,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:56:30,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. after waiting 0 ms 2023-03-20 10:56:30,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:56:30,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testCompactionWithHFileLink/e0ef86d3f8b59492e591fb6178d48b92/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-20 10:56:30,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:56:30,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e0ef86d3f8b59492e591fb6178d48b92: 2023-03-20 10:56:30,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1679309714175.e0ef86d3f8b59492e591fb6178d48b92. 2023-03-20 10:56:30,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d04a13b1886cbfc7a73fc35394f94d65, disabling compactions & flushes 2023-03-20 10:56:30,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:56:30,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:56:30,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. after waiting 0 ms 2023-03-20 10:56:30,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:56:30,494 DEBUG [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1505): Waiting on 1588230740, 2d9e3cf84600d62e9e4feea6fe7edd27, 3f7abb66b37c7d8d5eae5e6ae9446c14, 75a8b4d7351e02dabf5bd0e1f8bbe1ec, a5a7eb0c16894ccc2304d0ab4b06501b, cb051e8df6af553f31841872b29bc531, d04a13b1886cbfc7a73fc35394f94d65 2023-03-20 10:56:30,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyPolicy/d04a13b1886cbfc7a73fc35394f94d65/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-20 10:56:30,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:56:30,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d04a13b1886cbfc7a73fc35394f94d65: 2023-03-20 10:56:30,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1679309667430.d04a13b1886cbfc7a73fc35394f94d65. 2023-03-20 10:56:30,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3f7abb66b37c7d8d5eae5e6ae9446c14, disabling compactions & flushes 2023-03-20 10:56:30,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:30,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:30,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. after waiting 0 ms 2023-03-20 10:56:30,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:30,524 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-20 10:56:30,524 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-20 10:56:30,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/.tmp/rep_barrier/6fdac70099d041d3b950d1613f5f9507 2023-03-20 10:56:30,542 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fdac70099d041d3b950d1613f5f9507 2023-03-20 10:56:30,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionFromAdmin/3f7abb66b37c7d8d5eae5e6ae9446c14/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-20 10:56:30,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3f7abb66b37c7d8d5eae5e6ae9446c14: 2023-03-20 10:56:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1679309768349.3f7abb66b37c7d8d5eae5e6ae9446c14. 2023-03-20 10:56:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cb051e8df6af553f31841872b29bc531, disabling compactions & flushes 2023-03-20 10:56:30,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:56:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:56:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. after waiting 0 ms 2023-03-20 10:56:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:56:30,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithMonthlyPolicy/cb051e8df6af553f31841872b29bc531/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-20 10:56:30,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:56:30,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cb051e8df6af553f31841872b29bc531: 2023-03-20 10:56:30,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1679309639184.cb051e8df6af553f31841872b29bc531. 2023-03-20 10:56:30,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 75a8b4d7351e02dabf5bd0e1f8bbe1ec, disabling compactions & flushes 2023-03-20 10:56:30,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:56:30,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:56:30,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. after waiting 0 ms 2023-03-20 10:56:30,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:56:30,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/.tmp/table/4aa3dfe22a3a4d77967adafe9b0afda0 2023-03-20 10:56:30,592 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aa3dfe22a3a4d77967adafe9b0afda0 2023-03-20 10:56:30,593 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/.tmp/info/69af440823054d06b503129f200f99fc as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/info/69af440823054d06b503129f200f99fc 2023-03-20 10:56:30,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/75a8b4d7351e02dabf5bd0e1f8bbe1ec/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-20 10:56:30,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:56:30,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 75a8b4d7351e02dabf5bd0e1f8bbe1ec: 2023-03-20 10:56:30,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679309694784.75a8b4d7351e02dabf5bd0e1f8bbe1ec. 2023-03-20 10:56:30,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a5a7eb0c16894ccc2304d0ab4b06501b, disabling compactions & flushes 2023-03-20 10:56:30,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:56:30,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:56:30,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. after waiting 0 ms 2023-03-20 10:56:30,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:56:30,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69af440823054d06b503129f200f99fc 2023-03-20 10:56:30,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/info/69af440823054d06b503129f200f99fc, entries=226, sequenceid=130, filesize=37.9 K 2023-03-20 10:56:30,607 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/.tmp/rep_barrier/6fdac70099d041d3b950d1613f5f9507 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/rep_barrier/6fdac70099d041d3b950d1613f5f9507 2023-03-20 10:56:30,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/ns/testMinorCompaction/a5a7eb0c16894ccc2304d0ab4b06501b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-20 10:56:30,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:56:30,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a5a7eb0c16894ccc2304d0ab4b06501b: 2023-03-20 10:56:30,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1679309740005.a5a7eb0c16894ccc2304d0ab4b06501b. 2023-03-20 10:56:30,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2d9e3cf84600d62e9e4feea6fe7edd27, disabling compactions & flushes 2023-03-20 10:56:30,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:56:30,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:56:30,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. after waiting 0 ms 2023-03-20 10:56:30,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:56:30,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fdac70099d041d3b950d1613f5f9507 2023-03-20 10:56:30,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/rep_barrier/6fdac70099d041d3b950d1613f5f9507, entries=1, sequenceid=130, filesize=5.0 K 2023-03-20 10:56:30,613 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/.tmp/table/4aa3dfe22a3a4d77967adafe9b0afda0 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/table/4aa3dfe22a3a4d77967adafe9b0afda0 2023-03-20 10:56:30,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/default/testScannerOnBulkLoadRefHFiles/2d9e3cf84600d62e9e4feea6fe7edd27/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-20 10:56:30,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:56:30,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2d9e3cf84600d62e9e4feea6fe7edd27: 2023-03-20 10:56:30,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1679309662364.2d9e3cf84600d62e9e4feea6fe7edd27. 2023-03-20 10:56:30,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aa3dfe22a3a4d77967adafe9b0afda0 2023-03-20 10:56:30,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/table/4aa3dfe22a3a4d77967adafe9b0afda0, entries=27, sequenceid=130, filesize=6.6 K 2023-03-20 10:56:30,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 938ms, sequenceid=130, compaction requested=false 2023-03-20 10:56:30,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-20 10:56:30,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-20 10:56:30,639 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-20 10:56:30,639 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-20 10:56:30,639 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-20 10:56:30,695 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44189,1679309623230; all regions closed. 2023-03-20 10:56:30,704 DEBUG [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/oldWALs 2023-03-20 10:56:30,704 INFO [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44189%2C1679309623230.meta:.meta(num 1679309625924) 2023-03-20 10:56:30,716 DEBUG [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/oldWALs 2023-03-20 10:56:30,716 INFO [RS:0;jenkins-hbase20:44189] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44189%2C1679309623230:(num 1679309624944) 2023-03-20 10:56:30,716 DEBUG [RS:0;jenkins-hbase20:44189] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:30,716 INFO [RS:0;jenkins-hbase20:44189] regionserver.LeaseManager(133): Closed leases 2023-03-20 10:56:30,717 INFO [RS:0;jenkins-hbase20:44189] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-20 10:56:30,718 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-20 10:56:30,719 INFO [RS:0;jenkins-hbase20:44189] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44189 2023-03-20 10:56:30,728 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-20 10:56:30,728 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44189,1679309623230 2023-03-20 10:56:30,728 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-20 10:56:30,729 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44189,1679309623230] 2023-03-20 10:56:30,731 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44189,1679309623230; numProcessing=1 2023-03-20 10:56:30,736 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44189,1679309623230 already deleted, retry=false 2023-03-20 10:56:30,736 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44189,1679309623230 expired; onlineServers=0 2023-03-20 10:56:30,736 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39971,1679309621485' ***** 2023-03-20 10:56:30,736 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-20 10:56:30,737 DEBUG [M:0;jenkins-hbase20:39971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@550638d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-20 10:56:30,737 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39971,1679309621485 2023-03-20 10:56:30,737 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39971,1679309621485; all regions closed. 2023-03-20 10:56:30,737 DEBUG [M:0;jenkins-hbase20:39971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-20 10:56:30,737 DEBUG [M:0;jenkins-hbase20:39971] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-20 10:56:30,737 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-20 10:56:30,737 DEBUG [M:0;jenkins-hbase20:39971] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-20 10:56:30,737 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1679309624626] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1679309624626,5,FailOnTimeoutGroup] 2023-03-20 10:56:30,737 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1679309624631] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1679309624631,5,FailOnTimeoutGroup] 2023-03-20 10:56:30,738 INFO [M:0;jenkins-hbase20:39971] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-20 10:56:30,738 INFO [M:0;jenkins-hbase20:39971] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-20 10:56:30,738 INFO [M:0;jenkins-hbase20:39971] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-03-20 10:56:30,739 DEBUG [M:0;jenkins-hbase20:39971] master.HMaster(1512): Stopping service threads 2023-03-20 10:56:30,739 INFO [M:0;jenkins-hbase20:39971] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-20 10:56:30,739 ERROR [M:0;jenkins-hbase20:39971] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-20 10:56:30,740 INFO [M:0;jenkins-hbase20:39971] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-20 10:56:30,740 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-20 10:56:30,836 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-20 10:56:30,836 ERROR [Listener at localhost.localdomain/43657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e0bd87e rejected from java.util.concurrent.ThreadPoolExecutor@6a344167[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 534] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-20 10:56:30,837 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): regionserver:44189-0x1002e5d5c8f0001, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-20 10:56:30,837 ERROR [Listener at localhost.localdomain/43657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2eabc926 rejected from java.util.concurrent.ThreadPoolExecutor@6a344167[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 534] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-20 10:56:30,837 INFO [RS:0;jenkins-hbase20:44189] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44189,1679309623230; zookeeper connection closed. 2023-03-20 10:56:30,838 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@20ea6784] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@20ea6784 2023-03-20 10:56:30,838 INFO [Listener at localhost.localdomain/43657] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-20 10:56:30,838 INFO [M:0;jenkins-hbase20:39971] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-20 10:56:30,838 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-20 10:56:30,838 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-20 10:56:30,838 INFO [M:0;jenkins-hbase20:39971] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-20 10:56:30,838 DEBUG [M:0;jenkins-hbase20:39971] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-20 10:56:30,839 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:56:30,839 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-03-20 10:56:30,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-20 10:56:30,839 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-03-20 10:56:30,839 DEBUG [M:0;jenkins-hbase20:39971] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:56:30,839 DEBUG [M:0;jenkins-hbase20:39971] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-20 10:56:30,839 DEBUG [M:0;jenkins-hbase20:39971] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:56:30,839 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.33 KB heapSize=599.47 KB 2023-03-20 10:56:30,849 INFO [M:0;jenkins-hbase20:39971] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.33 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/91202e8410d74c14ac5f7c3368866676 2023-03-20 10:56:30,854 INFO [M:0;jenkins-hbase20:39971] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91202e8410d74c14ac5f7c3368866676 2023-03-20 10:56:30,855 DEBUG [M:0;jenkins-hbase20:39971] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/91202e8410d74c14ac5f7c3368866676 as hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/91202e8410d74c14ac5f7c3368866676 2023-03-20 10:56:30,863 INFO [M:0;jenkins-hbase20:39971] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91202e8410d74c14ac5f7c3368866676 2023-03-20 10:56:30,863 INFO [M:0;jenkins-hbase20:39971] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44265/user/jenkins/test-data/a08761da-6457-e5de-3794-c10974d85d64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/91202e8410d74c14ac5f7c3368866676, entries=123, sequenceid=1011, filesize=33.3 K 2023-03-20 10:56:30,864 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegion(2948): Finished flush of dataSize ~513.33 KB/525649, heapSize ~599.45 KB/613840, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=1011, compaction requested=false 2023-03-20 10:56:30,865 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-20 10:56:30,865 DEBUG [M:0;jenkins-hbase20:39971] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-20 10:56:30,870 INFO [M:0;jenkins-hbase20:39971] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-20 10:56:30,870 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-20 10:56:30,873 INFO [M:0;jenkins-hbase20:39971] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39971 2023-03-20 10:56:30,877 DEBUG [M:0;jenkins-hbase20:39971] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,39971,1679309621485 already deleted, retry=false 2023-03-20 10:56:30,979 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-20 10:56:30,979 ERROR [Listener at localhost.localdomain/43657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33c36fd6 rejected from java.util.concurrent.ThreadPoolExecutor@3cbbc139[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-20 10:56:30,979 DEBUG [Listener at localhost.localdomain/43657-EventThread] zookeeper.ZKWatcher(600): master:39971-0x1002e5d5c8f0000, quorum=127.0.0.1:62837, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-20 10:56:30,979 ERROR [Listener at localhost.localdomain/43657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6dfa523f rejected from java.util.concurrent.ThreadPoolExecutor@3cbbc139[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-20 10:56:30,982 INFO [M:0;jenkins-hbase20:39971] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39971,1679309621485; zookeeper connection closed. 2023-03-20 10:56:30,984 WARN [Listener at localhost.localdomain/43657] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-20 10:56:30,993 INFO [Listener at localhost.localdomain/43657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-20 10:56:31,082 WARN [BP-2029354168-148.251.75.209-1679309616057 heartbeating to localhost.localdomain/127.0.0.1:44265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2029354168-148.251.75.209-1679309616057 (Datanode Uuid fb3adef6-a96c-4d02-988b-61bdefd843de) service to localhost.localdomain/127.0.0.1:44265 2023-03-20 10:56:31,085 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/dfs/data/data1/current/BP-2029354168-148.251.75.209-1679309616057] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-20 10:56:31,085 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b360dccc-c04e-4c72-dafe-527db7d2ace5/cluster_68a772c3-12f1-ef8d-2cb2-b60dec716f8b/dfs/data/data2/current/BP-2029354168-148.251.75.209-1679309616057] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-20 10:56:31,133 INFO [Listener at localhost.localdomain/43657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-03-20 10:56:31,293 INFO [Listener at localhost.localdomain/43657] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-20 10:56:31,451 INFO [Listener at localhost.localdomain/43657] hbase.HBaseTestingUtility(1293): Minicluster is down